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ABSTRACT 

The report presents findings of an examination and 
followup of language intervention for language delayed preschoolers. 
Three objectives were addressed: to develop and use a strategy for 
assessing the long-term outcomes resulting from language training 
programs, before, during, and after the transition period from 
special preschool programs to the public schools; to determine what 
communication skills are needed in public school classrooms; and to 
develop auxiliary procedures to teach needed language skills that can 
supplement available language intervention programs. Ss were studied 
in the special preschool and followed up in regular public school 
classrooms. Analyses were also conducted to determine the 
communication demands in elementary school classrooms, and 
investigations were made of milieu intervention techniques (e.g., 
modeling and incidental language teaching) for use as auxiliary 
training procedures. A major finding was that while comprehensive 
language training efforts resulted in significant generalization, the 
generalization was limited to those structures within the child's 
general developmental level. Students did not appear to have acquired 
a generalized "learning to learn" strategy. Suggestions for improved 
programming focus on ways to incorporate research and generalization. 
(Author/CL) 
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ABSTRACT 



Successful ty^ansition from preschool programs to public school 
classrooms requires good communication skills. The handicapped child 
must have a basic knowlodge of the structure and functions of language 
and be ablevto display appropriate language skills in academic settings. 
One means of facilitating the critical transition to public schools 
is to insure that the handicapped child has learned the necessary 
language skills to adapt to the new setting. In order to prepare 
developmentally delayed children for successful transition it is 
important to 1) know how well current language training programs work 
in producing generalized language in academic settings, and 2) what 
language skills the transition child will need to display in order to 
communicate successfully in the classroom. 

Therefore, this research program had three objectives: 1) to 
develop and utilize a strategy for assessing the long-term outcomes 
resulting from language training programs before, during, and after 
the period in which children make the transition from special preschool 
programs to public schools; 2) to determine what communication skills 
are needed in public school classrooms; 3) to devt^lop auxiliary proce- 
dures to teach needed language skills that can supplement available 
language intervention programs. 

The research population for this project included language-dt layed 
children all of whom were initially judged to be candidates for regular 
public school placement if their communication handicaps could be 
sufficiently remediated. Each child was studied while enrolled in the 
Language Project Preschool , a special intervention program for preschool 
language-delayed children, and then followed up after they made the 
transition to regular public school classrooms. Studies were also 
conducted of elementary school classrooms to determine the communica- 
tion demands in these| environments, and investigations were made of 
milieu intervention techniques for use as auxiliary training procedures. 
The findings of thesej studies are presented throughout this, report. 
They are organized as they relate to the three primary objectives of 
the project specified above. The overall implications of this program 
of research are discussed in the final section of the report. A 
summary of dissemination efforts is also included. 
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I. INTRODUCTION 



After many years of planning and legislation, public education for 
handicapped children is becoming a reality. Practical problems of 
implementing P.L. 94-142 remain, but major steps toward providing 
educational opportunities for all handicapped children have been taken. 
The impact of legislation mandating education for the handicapped has 
been felt at the preschool level and has resulted in special programs 
teaching prerequisite .academic and daily living skills before children 
enter public school . ^Specific curricula of such special preschool 
programs vary, however, most have two parallel goals: to teach skills 
that are immediately useful to the child, and to teach skills that 
will be carried over or generalized to other settings. 

Language is a critical behavior for normal and devel opmenal ly 
delayed children, and its importance in learning and social interaction 
is wel 1 -documented (Blank, Rose, & Berlin, 1977). Nearly every special 
preschool emphasizes lar.;juage learning and many employ special teaching 
programs and staff to insure individual language truiriing. A large 
number of language training programs have hcen developed to teach 
comprehensive language skills (Fristoe, 1976), although the effective- 
ness of such programs in producing useful ski Ms for the immediate 
environment or in providing generalized skiU.s rur subsequent use is 
general ly untested. 

The problem in ''a.^qua^^e training is essentially the same one faced 
in all asoects of presc :r,ol curriculum. Spedal training is needed 
to ensure that atypical r'lildren will 'oarn essential skills necessary 
for maximum normalization. At the he rt of the problem is the need 
for general iz;^c skill acquisition that will be maintained across time, 
persons, and settings. Generalization represents a continuum extending 
from the training settinq to all the temporally and physically remote 
settings the handicapped child eventually will enter. At t'^e near end 
of the continuum is generi'l ization to situations that are s imilar 
to training, for example, generalization to a second trainer or a 
second training setting. In the middle range of the continuum is 
generalization to novel, unstruc^:ured situations occurring while the 
student is still enrolled in trail ing. Although the stimulus 
characteristics may be different from those encountered in tra./ing, 
the recency of training makes generalization of learned responses only 
moderately difficult. The most difficult generalization is that which 
occurs after training has been completed, in novel circumstances. 
This long-term generalization O' maintenance represents the child's 
use of learned behaviors in subsequent setting*"., such as the public 
school . 

Ultimately, the effectiveness of a remedial language training program 
is best measured by the extent that it prepares the student to commu- 
nicate effectively in nontraining environments. If the program i*: 
effective, students learn generalized communication skills that t'.cy 
display after training has ended and in environments far removed from 
the training setting. 
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Language is an essential behavior for success in public school. 
Nearly all acaJeniic skills have a language coniponont, even t:he simplest: 
skills such as color labeling, counting, and everyday living activities. 
The format for teaching, and thus, for learning incorporates language 
in almost every instance. Tho teacher gives instructions, asks children 
to perform or recite, and asks simple questions about the lessons, 
the child and the classroom. The sophistication and complexity of 
instructions, questions, and verbal interactions may vary by the age 
or skill level of the child, still there is a language demand in every 
educational setting. The suqcessful student at any level will need 
to know a considerable amount about how language works. 

Often, preschool programs and curricula appear to be structured 
without consideration of the children's future participation in other 
educational settings. Traditionally, language training programs have 
been formulated on the basis of normal syntactic or semantic develop- 
ment with little consideration of the linguistic and social communica- 
tive competencies needed in future academic settings. The result of 
the failure to fit language training to future language demands is 
that much of what has been trained m;.;y not be functional for the child, 
and thus, is not used. Generalization of previously learned language 
skills does not occur because there are few appropriate opportunities 
for the child to display these skills and the process of transition 
is made more difficult because the child may lack language skills that 
are critical for learning and interaction in the new setting. 

Previously, there has been no data base describing the linguistic 
and social communicative competencies needed by handicapped children 
in public schools. Normative data tends to focus on the development 
of communicative competency in mother-child interactions (e.g., Bates, 
1976) and does not provide sufficient description of the specific 
communication skills required in classrooms or consider the special 
problems of the handicapped child. 

Most language training programs offer little data on communica- 
tion needs because they have been developed either from the normal 
sequence of development or the authors' best guesses about what 
language is functional for the child. A specific assessment of the 
communication requirements in public school classrooms handicapped 
children attend is necessary to form the basis of a curriculum for 
teaching critical, general izable communication skills. A curriculum 
designed on the basis of classroom communication requirements may 
simplify one aspect of the generalization problems. Typically, when 
generalization fails to occur, there are two possible causes: the 
child and the environment. The child may fail to generalize due to 
lack of sufficient training, or the child may be well trained yet 
generalization does not occur because the child's skills are not 
required, prompted, or supported by the natural environment. One 
cause of the failure to generalize might be eliminated by teaching 
communication skills known to be functional. With careful training, 
emphasizing generalization facilitation, carry-over from training 
to classroom is likely when skills have been selected because .they 
are required in that^ setting. 
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lUoro aro throo ossontUil coinpononts of functional lanqiicUH* 
trMininy: 1) solocfion of tarfjot hohaviors for trainincj that coincUlo 
With the coinniun icat ion skills needed by students in nontraininy 
settings; 2) thorounh training of these skills; and 3) tjeneraMzation 
ctnd maintenance of trained skills to settings physically and temporally 
clistant from the training sotting. The first two components are 
critical training variables that influence the third component, the 
clesired outcomes of training. It is unlikely that trained skills 
Will generalize unless the skill is trained to mastery level with 
procedures designed to facilitate generalization. If the trained 
skills coincide with the communication demands of nontraining settings, 
then opportunities for using trained skills will occur and the trained 
responses will be reinforced by natural contingencies. The newly 
learned language will function to control the environment. Together, 
thorough training and selection of important, highly functional skills 
should insure generalization and maintenance of training across 
settings and time. 

A case in point that demonstrates the interrelated aspects of 
training and curriculum variables is the language training student in 
transition from a special preschool language trianing program to a 
public school classroom. The student has been taught a set of skills 
in language training. The student's task is now to use those skills 
to communicate in an unfamiliar setting after training has been 
completed. A student's success will be determined by the specific 
skills taught in training, the extent to which these skills overlap 
With the behaviors required in the classroom, and the student's trained 
ability to generalize across persons, settings, and stimuli. 

Generalization and maintenance of useful skills is critical to the 
student's overall performance in the public school because the format 
for learning is implicitly language based. By teaching specific 
skills required in the classroom in a manner that facilitates 
generalization, transition from preschool to elementary school can 
be accomplished with greater ease. Important learning time can be 
increased and the potential of the handicapped child more fully 
realized if the adaptation to the new education setting is quickly 
and satisfactorily accomplished 



PROJECT OBJECTIVES AND OVERVIEW 

To address the problems pointed out in this introduction, three 
research objectives were conceptualized by our research team. Each 
is closely related to the others and to the overall problem as 
described here. They are as follows: 

1. To assess the generalized effects of preschool language training 
onjtuden ts before and during enrollment in elementary school . 

This objective was focused on determining the generalized changes 
in students' communicative language resulting from language training 
during the period prior to entry into public school and after they 
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iMMjin attnrirlifui put)! Ic school. It: was proposed (:o inodsiiro siil^jocts ' 
l(Uii|ihu|o lonq I r.iiil inal ly durinfj l:ho I: lino Mui.y aro oiirol lod in lanqihuj^^ 
UsiinhMj and proschoo! prof)rains and noar l:ho end of l;hoir first, yoar 
of tMiroriiiiunl: in oloiiuuit:ary school, DIroct: iiiuasuronionl. of s.yot.actji; , 
loxica U and sniiiant: ic gonora M^^a t:1on from l:ra lning was inado in 
addit ion l.o iiioasurns of t:ho child's overall coinimnvicat:1nn coinpi^loncy , 
t.fiiis providinq a roasonal)ly coin|)lot:o |)yn)filo of l:ho offin.t:s rosnlt.inq 
from lan()iic\(io I:ra1n ln(|. Many nl;hor aspoct:s of tJioir coinmun leaf ion 
dov(?1opinont <\nd 1 iini LatJons on it: worn also sLudiod and will Uo 
roportod horn. 

?. , (Jh^i^ryo jnibl schoo^l cl assroonis i n order „t:o do teniii nf^ wha I: 

The acadeniic settings that languacje training "gr'aduates" entered 
were systematically assessed for communication demands. By assessing 
these settings, it was possible to propose language training that would 
provide the most useful sl<ills for the child entering the public school, 
thus, improving the student's chances of succeeding in those settings. 

3 . Develop auxiliary language t raining procedures to te ach specific 
communi cation skills typically required in school setti ngs , 

It was initially anticipated that a number of specific skills 
were likely to be useful in school settings. These skills are not 
necessarily taught by language training programs that teach primarily 
syntax, vocabulary, and semantics. Thus, it was necessary to develop 
procedures for teaching additional skills as an auxiliary program to 
be used with regular grammatical teaching, and to experimentally 
analyze these procedures. 

These three research objectives were closely related and taken 
together represent a comprehensive analysis of the problem of teaching 
language for successful transition to elementary school. The remainder 
of this report will discuss the specific findings relevant to each 
of these objectives and then, in Section 3, these findings will be 
integrated into a general discussion and implications section. 
Suggestions for future research and program development will be made 
in that section also. Also included in this report are a summary 
of dissemination activities to date and all appendices referred to in 
the report. 

A separate financial report has been prepared by the Office of 
Research Administration at the University of Kansas and is not 
included with this report. It will be sent under separate cover to 
the appropriate budgets and contracts officials. 
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l ivUnintj on sl:iHl(Mils lH|fon) fUut iluri tMirnlliiKMil: In 

This iU)Jo(:l;ivo involvos hiiui i l:u(t ina I nuMsuroiiuMil. of I.ukjkiuio 
iH?r)(?r(\l ion in a cti i ld's nal.ural onv ironiiKnils ilin^ in() t.ho L iiiuj l.ho 
chilli is onrollod in a proschool LrO(\tiiuuU iimnram and Ihon durinq a 
roriov^-iip poy'iod afl-oy' l;ho child has ontoyMMl oloinonlary schvjol « In 
many rnspocLs Uvis rosoarcti ronns the bacl<bono of all our efforts. 
It, has boon inado possible Lhromih tUt) dovolopinoni: of a so|)h isticatod 
coniputor analysis sysLoiii for doal inc) with large amounts of naturalistic 
child lancjuacjo data. Through ttiis research we have determined several 
constraints on natural language generalization and the specific 
characteristics of these constraints. We have also identified which 
aspects of traditional one-to-one language therapy are functional and 
which are not. The follow-up component of this research has suggested 
that language delayed children tend to "plateau" in terms of their 
linguistic development when they enter elementary school after 
typically making substantial progress during preschool intervention. 
This effect has led us to consider ways to better prepare these 
children for the realities of public school classrooms. 

In this section we will report results on six sub-components of 
this objective. Taken together the research reported in these 
components represents a thorough analysis of the questions posed in 
Objective 1. These sub-components are: 1) individual subject and 
group analyses of longitudinal language generalization; 2) a group 
analysis of the effects of high and low rates of speech usage on the 
distribution of pragmatic functions; 3) a group analysis of the effects 
of form complexity (length of morphemes) on function usage by students; 
4) the public school transition follow-up; 5) a theoretical model 
resulting from this research (and other efforts) for relating form 
and function to the generalization of language. Results for each of 
these components are presented below. First, the general methods 
utilized in this research are presented. 

General Methods 

a. Subjects and settings . All basic longitudinal generalization 
research was conducted at the Language Project Preschool and all 
transition and follow-up research was conducted in public school 
kindergartens in Lawrence or surrounding communities. The Language 
Project Preschool is a facility of the Bureau of Child Research at 
the University of Kansas. The preschool annually serves 10-12 language 
delayed preschool children with mild to moderate language delays 
(6 month5-2 years below age level). The children participate in 
a regular half-day preschool curriculum, and receive daily language 
training during 20-minute sessions with a speech clinician. Children 
are usually enrolled for 1 to 2 years, and at about 5 years of age 
make the transition to elementary school. 
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t4j^,U.^<^^ll*'. '-^'^ir siihj(M:l: r'octrivod 'iysl:(^i)ia 

huHHi.iiio l;rainiivi un ttu» Sh^rino I -Waryas Witvniatin tr'ainlrui i^roqrMiii. 

^\i)mvi\] fomc\l and iiril iiil (jonDrfi I ua I; ion lirociMhiros ot this 
prmirani avn (l isciissiMl r)(Vh)w, I t is nn^'iMit ly av<ti lat)l(j coKiinortM a I I y 
(roil) loarhlnu Rosourcos . 

lollowiiui prM)t|t\uihS|HM:| r ic assossnHM) t » a chlM i)o«| inn iiui on Iho 
StroiiH)! -Waryas trNiininq iironraiii in plactMl at t.tu) spocItU: st(M) or 
tlu) ptMxnMni tlu\t most clost^ly rM^S()iiil)los ttio cli ild's larv|nat|t^ at) 11 i t, ii^s , 
Oni:o tys\ininq coiiiiiionci^s , ttit^ clil ld moots da ily witli a larKjiiatjo tyainor 
lor ir)«30 minuti^s. Traininti is cart^iod out oitlier ono-^to-ono or in 
a small (jyn)iip of cfiildron rocoivirui similar tralninij. Fho proijr()m 
iitili/.os inod(Hiru|, imitation, and difforontial rointorceMiiont to toact) 
tlu^ i.oritiMit of each stop. Childron iiiov(! throiuih tlu^ [)ro(]ram t)y 
loach ing cri tor ion on each stop. Tho initial critoria roqirironiont 
is that tho child domonstrato at least 80-90:' succoss on a serios of 
trials ovor a cjivon traininq itom during two consecutive sessions, 
rho child's abilities to generalize within tt)e training sotting to a 
second trainer, across similar stimuli, and across similar structured 
settings is then probed. The child must display these forms of 
probe generalization before moving on to the next step of the program. 
If the child does not geney^alize across these simple dimensions, 
there is no reason to expect generalization to the more complex 
natural environment. If the child scores less than 70% on any 
generalization probe, specific training for that dimension of 
generalization is instituted. When the child reaches training 
criterion on the trained generalization items, he is again tested with 
new examples, a new trainer or in a new setting. Training continues 
until the child is successful on all generalization probes for a 
specific training step. The sequence for generalization probes and 
training is shown in Figure 1. As the child progresses through the 



Insert Figure 1 about here 



training steps, reliability is assessed to determine if the trainer 
is following the training procedures appropriately, and to determine 
if the child's performance in training is being recorded correctly by 
the trainer. The use of within-setting probes and reliability measure- 
ments assures that the program is applied systematically and thoroughly 
within and across subjects. 

c. Data collection procedures . Throughout this research project, 
verbatim samples of subjects' language and contextual information were 
collected in exactly the same manner. Data collection procedures 
are described below. Additional information about other data 
collection is contained in other specific sections of this report. 

Verbatim samples : Verbatim samples of subjects' speech were 
recorded by a trained observer during a 15-minute observation period. 
During each observation, a tape-recording of the subject's language 
was obtained by having the subject wear an apron containing a small 
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wireless microphone (i.e , telemetry system). The subject's 

speech was transmitted to a Receiver and tape recorder located in 
an adjacent room. After ihe ot^servation was over, the observer 
used the tape-recorded sample to supplement and correct the record 
mode j_n vivo. The observer ^he^ked all jji vivo coding and did 
additional coding as nece^s^^y. The sample was then prepared for 
computer entry, entered into the subject's data file, and analyzed. 

Contextual and f unj:t 1 on^]_ jnfor^niatjon ; Concurrent with the 
recording and transcription Of verbatim samples, a trained observer 
coded each utterance to ihdi^at^ th^ purpose it served in a communica- 
tion interaction (e.g., iht^^action^l , affirmative, verbal play, 
self-regulation, imitatioh, ^equest, etc.). The correctness (as 
determined by appropriate ]e\ic^n) ^nd appropriateness of the utterance 
to the ongoing interactioh W^s coded. The observer also indicated if 
the utterance was directed to a pee}r or teacher, and if there was an 
obvious verbal prompt for th^ utterance (e.g., a question to the 
subject) . 

Complete copies of obs^^vat ion^l codes for verbatim and contextual 
data collection are inc1ude<J in Appendix 2. 

d. Rel iabil ity . Ri^oi^Ous reliability assessments in experimental 
research are necessary to iii^ur^ validity and repl icabil ity of/ 
procedures and results. F^eHabili'tv has been carefully assessed in 
mos. experimental analyse^ of generalization, however, reliability of 
verbatim transcription and eroding in psychol ingui stic researches 
seldom assessed (Dale, 19>8)^ Developmental psychol inguistics is a 
relati^/ely youthful scientific discipline. Nevertheless, many of its 
findi;^o may be suspect b^c^^se little attention has been given to 
observational reliability an^ across-subject repl icabil ity. With this 
in mind, careful attention will be Paid to issues of reliability in 
the proposed research. 

The recording and coding o'^ verbatim language samples necessitated 
thorough reliability asse^sin^nts . The high quality of the recorded 
sample, in combination with ^he observer's record, typically provided 
highly reliable data (aveba^^ng about 90%). Reliablity was assessed 
once in every five observations by having two observers simultaneously 
prepare verbatim transcrifit^ o? the subject's utterances; these 
transcripts were compared mO^ph^rne by morpheme for agreement. 
Observers also coded the function of utterances and the environmental 
support available for each jtte'^aiice. In these instances, reliability \ 
of coding also was computed '^y comparing each categorization of the. 
utterance for agreement. D^ta collected in an observation for which 
the reliability score was ]e^s than 80% was not used. Reliability in 
all instances was calculate*^ using the formula: 

Number j yf^gr|enients^ ^ y inn = o/ ^piinhiiitv 

Number of agreements + number of disagreements ^ "'''^ '° '^-^ 

Overall reliability Cin Verbatirri and contextual coding across 230 
reliability observations ^p^Hning the length of the project was 90% 
and ranged from 46% to 10Q%. 

13 



9 



The reliability of all behavioral codes and observational proce- 
dures used in other aspects of this research was similarly evaluated. 

e. Computer analysis . The complexity and massiveness of the 
longitudinal natural language samples gathered required that a 
sophisticated computer analysis system be developed and utilized. 
Two types of information were entered into this system: 1) a list 
of syntactic structures that a given subject was trained on during 
the course of the study and the date on which training commenced; 
2) all the verbatim speech samples taken on the subject in chronological 
order. Prior to entry each verbatim sample was reviewed and all 
instances of entirely unintelligible utterances, recitations, singing, 
noise words (e.g., oh, ugh), and counting were removed from the 
transcript. In addition, certain nonstandard forms were converted to 
their standard forms (e.g., yeah to yes; nope to no, etc.). The 
computer program was designed to do the following functions: 

a. assign part-of-speech categories to all words; 

b. keep track of all words found in a child's language samples; 

c. keep track of all the examples of trained phrases found in 
the samples; 

d. keep track of all the words and sentence patterns taught in 
language training to the child; 

e. find all the trained words and sentence patterns that occurred 
in the language samples (generalization to the natural 
setting) ; 

f. calculate MLU (mean length of utterance) and Upperbound 
(longest utterance) scores for each sample; 

g. print a summary of all these findings. 

The key to the operation of the program was a two-part interactive 
system designed to attach a syntactic descriptor to each word used by 
a given child. One part, the system dictionary, consisted of several 
hundred words commonly used by individuals with linguistic skills 
associated with an MLU of 1.0 to 4.0. Each word had a part of speech 
associated with it. For example, ball - noun, eat - verb, blue - color 
adjective, he - 2nd person pronoun, etc. Each child also had his or 
her own dictionary made up of words used by that child and not found 
in the system dictionary. Using these two dictionaries the computer 
coded each utterance as a syntactic string (e.g., *'I want that" = 1st 
Person Pronoun - State Verb - Demonstrative Pronoun; "Throw me the 
ball" = Verb - 1st Person Pronoun - Article - Noun) as the operator 
entered it. Each time the computer came across a new word not in its 
dictionary system it would ask the operator "What is the part of 
speech of the word "funky" in "You funky guy," and the operator would 
type in the appropriate designation, in this example, "Adjective". 

Some words can be used in different ways and therefore cannot 
always be tagged as the same part of speech. For example, "run" 
can be used as both a noun (as in "We went for a run") and a verb 
(as in "Let's run"). For a large set of words often used in various 
ways, the computer was programmed to always ask the operator to 
assign the appropriate part, of speech. For words used in multiple 
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or unusual ways only by a given subject, the operator would specifically 
assign the appropriate part of speech as she was entering the term. 
In cases where a word was used in a particularly odd or unexpected 
way, the observer who recorded it would assign the appropriate part 
of speech designation and include it on the written transcript. In the 
few cases where no one could confidently assign a part of speech, the 
entire utterance was discarded. 

The same individual entered al 1 the data collected and analyzed 
throughout the entire study. She did not personally know any of the 
subjects involved nor have more than a general understanc *ng of the 
project. However, she had a good working knowledge of syntax and 
quickly developed a keen appreciation of the usage patterns typically 
manifested by each child. 

Once all the child's training and verbatim data had been entered 
and each utterance had been coded as a syntactic string, a routine was 
executed that compared each utterance pattern with the patterns 
trained or to be trained. Two summaries of structure generalization, 
first occurrence (novel examples of a trained pattern) and frequency 
(total number of instances) of usage of the trained pattern were 
computed for each verbatim sample as well as MLU and Upperbound. The 
computer analysis system is overviewed in Table 1. This system generated 
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the first level of data analysis on which further analyses discussed 
in this section are based. 

Individual Subject and Group Longitudinal Analyses of Language Generalization 

During the past 15 years many comprehensive language training 
programs have been developed and disseminated. These programs are 
widely used in the treatment of all types of language deficits and 
delays. Although a great deal of research has been conducted 
utilizing probe strategies to assess generalization of specific language 
skills along some limited dimensions, little has been shown about the 
generalized effects of language training on the child's actual language 
use in the real world outside the lab or training room. Many types of 
effects are possible including syntactic and semantic, pragmatic, rate, 
and general developmental. However, as part of this research program 
we have investigated the generalized effects of comprehensive language 
training on the structural aspects of eight language-delayed preschool 
children's productive speech. In contrast to most previous research 
on language generalization, this investigation was conducted by 
analyzing speech samples of the children in everyday classroom 
conversations. 

The. eight preschool children in the study displayed developmental 
language delays ranging from 6 to 18 months. Six came from low SES 
backgrounds. All attended a special preschool program for language- 
delayed children where they were involved in the present analysis for 
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Table 1 

Syntax Analysis [Routine 

EXPLANATION 
Utterances 1n sample are read sequentially 



2. Scgrent rain clausc(s) 



3. Assign syntax notation 



Rcrnoves vocatives (names and attentlonal words) 
dnd interactionals (e.g., please) 

Each vs-ord was previously assigned a part of 
speech In the word analysis stage. Parts of 
speech are recalled from the sentence record 
end printed In sequence to produce a syntactic 
string 



4. CcTpare syntactic pattern of 
utterance with training 
patterns 



Program searches the list of trained syntax 
forms and Indicates if the utterance matches 
a training form 



5. Determine If form Is novel 



Program corrpares current utterance with all 
previous examples of the same syntactic form 
and indicates if the utterance Is an old or 
new example of that form 



6. Enter example Into subject's 
clause dictionary 



7. Repeat until all utterances 
are analyzed 

8. Print out summary of data 



If the example Is novel, it Is entered into the 
list of exanples of the form used by the subject. 
Tallies of old and new examples of each grammatical 
form^are kept 
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EXAMPLES 

SAMPLES 

Nancy, I get cookie 
Wont cookie, please 



CLAUSES 



Clause 


Syntactic 
Form 


New/ 
Old 


Trained 


• - 
Occur 


I get cookie 
Want cookie 


Pro V N 

V n 


liew 
Old 


!^o 
Yes 


1 
2 



TRAIIIED FORnS 



Syntactic Form 


Exampl es 


N V 


Doy eat 
Dog run 


Pro V N 


I want cer 



CLAUSE DICTIONARY 



Clause 


Syntactic 
Form 


First 
Date 


Last 
Date 


Occur 


I want ball 

Boy sit 

I get cookie 


Pro V N 
N V 
Pro V N 


9/18/78 
9/20/78 
9/27/73 


9/1S/78 
9/20/73 
9/27/78 


1 

2 
1 





CLAUSES FOUND Ifl SA.MPLE 




Date: 9/27/70 
Settinq: LPP 






PRO V N 


Clause 


New/Old 


Trained? 


' Occur 


I get cookie 
I want car 


New 
Old 


Partial 
Identical 


1 

2 
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periods ranging from 8 months to 2 years. While enrolled in the pre- 
school each child received 20 minutes of training daily on a comprehensive 
language training curriculum developed by Stremel and Waryas (1974), 
The developmental characteristics of each subject are summarized in 
Table 2 and examples of the structures trained and the sequence of 
training are shown in Table 3. 



Insert Tables 2 and 3 about here 



Structures were sequentially trained in both the receptive and 
productive modalities by a speech therapist in a training room 
adjacent to the classroom. Standard training procedures included the 
systematic use of behavioral techniques such as shaping, fading, 
modeling, differential reinforcement and use of multiple exemplars. 
Criterion for passing a training step included a demonstration by 
the child that he/she could produce the trained structures in probe 
situations across trainers, settings^ and stimuli. All subjects 
successfully met criterion on each structure that they were taught. 
Only data on the productive generalization of trained structures 
(i.e., syntactic forms) to classroom freeplay usage will be discussed 
here . 

Throughout the study observers collected 15-minute verbatim speech, 
samples of ""he subjects' language in a classroom freeplay setting. 
Each subjerT. was observed approximately four times per week and an 
average total of 104 observations were taken per subject. These 
observations were distributed equally across time for each subject. 
Generalization of the trained structures was analyzed from these 
samples with the assistance of a computer program that compared the 
subject's trained forms with their verbatim speech samples. 

The results are summarized in Table 4."^ Of the 55 structures 
trained, 39 {71%) were generalized by the children to the classroom. 



Insert Table 4 about here 



For individual subjects, generalization ranged from 54% (7 of 13 forms) 
to 100% (4 of 4). These results suggest that training did have a 
substantial effect in that the majority of the forms trained were 
incorporated in the children's productive repertoires. Furthermore, 
on the average forms that generalized were o;^served within the 
first 12 observations (3 data blocks) after their training was initiated 
by the therapist, suggesting the training was indeed responsible for 
their emergence at that point. However, the primary question we would 
like to address is why generalization was not 100 percent? That is, 
why did some forms never generalize? 

Table 4 also shows the average morpheme length of structures that 
generalized as well as the average length of those that did not. It 



Individual subject longitudinal general ization data , upon which the 
summary in Table 4 is based, are presented in Appendix 1. 



Table a 

CO 

Language Project Preschool 
Subject Characteristics 



Subject 


Sex 


Length of 
Observation 


Aqe 
Start 


at 

Fnd 


Hous 
Languc 
Start 


,ton 

Kje A(]e 
End 


Peab 
Menta 
Start 


ody 
1 Age 
End 


Ml i 

start 


J 

End 


1 1 1* Q n 
U L Lc 1 clIlL 

Start 


cb ptir UDS . 
End 


D.Q. 


Ma 1 e 


26 months 


32 mo 


58 mo 


25 mo 


48 niO+ 


22 mo 


52 mo 


1.2 


2.1 


4.3 


51.4 


D.P. 


Male 


18 months 


48 mo 


66 mo 


35 mo 


48 mo+ 


34 mo 


87 mo 


1.8 


3.0 


3.6 


26.2 


J.H. 


Male 


8 months 


48 mo 


56 mo 


48 mo+ 


48 mo+ 


46 mo 


59 mo 


2.8 


2.9 


21.5 


39.6 


J.J. 


Male 


17 months 


30 mo 


47 mo 


29 mo+ 


48 mo+ 


27 mo 


52 mo 


2.5 1 3.2 

1 


18.6 


49.3 


K.P. 


Male 


12 montfis 


37 mo 


49 mo 


31 mo 


36 mo 


27 mo 


36 mo 


1.5 


2 . 6 


4.4 


34.9 


L.B. 


Feiiial e 


14 months 


36 mo 


50 mo 


24 mo 


43 mo 


27 mo 


— - 
45 mo 


1.2 


1.7 


2.5 


17.2 


M.H. 


Male 


17 months 


36 mo 


53 mo 


36 mo 


60 mo 


29 mo 


56 mo 


1.6 


3.5 


7.6 


33.5 


W.B. 


Male 


8 months 


37 mo 


45 mo 


48 mo 


60 mo 


37 mo 


48 mo 


2.7 


3.1 


23.5 


26.0 


MEANS 


X 


15 months 


38 mo 


53 mo 


35 mo 


50 mo 


31 mo 


54 mo 


1.9 


2.8 


10.8 


34.8 


RANGES 




8-26 months 


30 
^ 48 


45^/" 
/ 56 


24 

^ 48 


36 

/^60 


22 

^ 46 


36^/ 
/87 


1.2/^ 


1.7,/ 
3.5 


2.5 

y^ 23.5 


17.2 ^^.^ 
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Table 3 



Training Examples 



SUBJECT: K.P. 



Structure 



Verb-Noun 



Examples 

cut paper 
open door 



Pronoun-State Verb-Noun 



I want whistle 
I 1 ike drum 



SUBJECT: D.P, 



Structure 



Noun-Verb-Color Adjective-Noun 



Noun-Verb (ing) -Preposition-Noun 



Examples 

man wear black coat 
gi rl ride brown horse 

airplane flying over clouds 
boy sitting in wagon 
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Table H 
GENERALIZATION SUMMARY 



Child 


=f Forms 
Trai ned 


!T Forms 
General ized* 


% Forms 
General ized 


Overal 1 
Child 
MLU 


Mean Length 
General ized 
Forms 


Mean I pnath 
Non-General ized 
Forms 


O.J. 


4 


4 


100% 


3.0 


2.5 


— 


k.p: 


4 


4 


100% 


2.1 


2.5 


— 


M.H. 


9 


0 


89% 


2.6 


3.4 


5.0 


L.B. 


5 


4 


80% 


1.5 


2.5 


2.0 


O.P. 


10 


6 


60% 


2.7 


3.0 


4.3 


W.B. 


5 


3 


60% 


2.9 


2.3 


4.0 


D.Q. 


5 


3 


60% 


1.8 


2.7 


4.0 


O.H. 


13 


7 


54% 


2.4 


3.8 


4.0 


MEANS 
or 

IQBls 


55 


39 


71% 


2.4 


2.8 


4.0 


RANGES 


4-13 


4-8 


54-100% 


1.5-3.0 


2.5-3.0 


2.0-5.0 



^Criterion: Non-imitative usage in 2 separate observation blocks (4 observations 
to a block) . 
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indicates that the forms which did not generalize were the longer ones. 
Figure 2 makes this point even clearer. It shows the percent of 
generalization graphed as a function of the morpheme length of the 
structure trained. In other words, in general the longer structures 



Insert Figure 2 about here 



trained were not incorporated into the subject's normal productive 
repertoires despite the fact that the subjects appeared to learn them 
and could produce them under specific probe conditions across trainers, 
settings, and stimuli. Why? 

The answer could be artif actual in nature, of course. For 
example, since the longer structures are also inherently trained later 
in the curriculum, the difference could be due to simply not observing 
them long enough. However, this was not the case. As shown in Table 5, 
when the longer forms did generalize they manifested themselves in the 
repertoires of the subjects just as quickly as the shorter forms. 



Insert Table 5 about here 



The findings and the fact that on the average the four-word forms were 
observed for across 57 observations (14.2 data blocks) suggests this 
type of artifact is not a reasonable explanation of the data. 

Another possible reason for the difference could be that the 
four-word forms represented odd or unusual forms having little 
function in everyday speech. Thus the subjects did not utilize 
them simply because they had little or no pragmatic usefulness. 
However, in fact the forms trained were very common and quite frequently 
observed in use by individuals with MLUs of 3.0 and greater. 

There may be still additional explanations for this finding, but 
the data seem to most strongly support this conclusion: Generaliza- 
tion appeared to be determined primarily by the degree of correspondence 
between the morpheme length (complexity) of the trained structure in 
relation to the morpheme length (complexity) of the subject's spontaneous 
language. It was as if the communication matching phenomena observed 
in normal acquisition was controlling generalization here too. The 
subjects (see Table 4 again) would utilize forms that were slightly more 
complex than that of their everyday speech. Hence the MLU of generalized 
forms was about 2.8 overall while the subject's overall MLU was about 
2.4. But they would not general ize— not incorporate into their everyday 
speech— forms that were more than a morpheme greater than their 
everyday speech. This, of course, makes sense from a developmental 
perspective. The real utility of the finding is its implication for 
language remediation strategies. 
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Figure 2 



Generalization by Structure Length 
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Table 5 



Variables 


Structure Lenq; 




2 word 


3 word 


4 word 


# Subjects 


8 


8 


5 


# Forms Trained 


18 


16 


14 


n General ized 


17 


15 


4 


% General ized 


94% 


94% 


29% 


Mn if Observation Blocks 
Before 1st Occurrence 
of Generalized Forms 
Observed 


2.9 


2.8 


2.7 


Mn ? Blocks Possible 


18.2 


13.7 


14.2 


Mn if Blocks Occurred In 


12.2 


8.9 


7.3 


% Blocks Observed In 


67% 


65% 


49% 


Mn it Blocks Possible for 
Forms that did not 
General ize 


14.0 


17.0 


14.9 
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Nearly all language training programs lay out a sequence of 
structures to be trained from simple to complex that usually roughly 
reflects the standard developmental account of language acquisition. 
It is quite possible to successfully train a child along this sequence 
and— we suspect on the basis of this data— then, to eventually leave 
him behind as the complexity of items trained gets more and more out 
of line with his actual productive language capability. Probably 
because he has become so tuned into the training format itself, this 
child may appear to keep up with the trainer while simply failing to 
incorporate the more complex forms into his usage repertoire. The 
training still could be having many useful effects— just not the ones 
that are primarily intended. However, maintaining the complexity of 
a training curriculum within the general developmental level of the 
child and then increasing the length of trained structures as the 
child's MLU increases, may be necessary to insure generalization of 
all trained structures. 

The Effects of High and Low Rates of Speech Usage on the Distribution 
of Pragmatic F unctions 

A thorc qh analysis of language generalization to the real world 
requires th. we understand under what conditions generalization is 
impeded a*^ ider what conditions it facilitated. Rate of verbaliza- 
tion has b Drrelated with generalization in several analyses (e.g.. 
Warren, Rog ^ '-rren, & Baer, 1983; Hart, 1980; Rogers-Warren & Warren, 
1980). High races or verbalization correlated with increased like- 
lihood of generalization as well as increased rates of language 
acquisition (Nelson, 1973). But are there any differences functionally 
in the speech of a child when they are talking at low rates versus 
when they are talking at relatively high rates? Do some pragmatic 
functions tend to dominate low rate speech and others tend to dominate 
high rates of speech? If so, this might help explain why rate is so 
crucial to language acquisition and generalization. It might also 
provide important information in terms of specific pragmatic form 
intervention targets. With these issues in mind we conducted an 
analysis of the effects of high and low rates of speech usage on the 
distribution of pragmatic functions by our subjects. 

This analysis was conducted by dividing the subjects* longitudinal 
verbatim observation data into observations in which the subject spoke 
15 or more utterances and those in which he/she spoke less than 15 
times over a 15-minute period. From these two groups of data 100 
utterances were then randomly selected. These utterances were then 
distributed across several basic pragmatic categories (each was 
initially coded, by one of these categories). These categories were 
declaratives, questions, answers, request commands, response to mands, 
vocatives, and imitations. Each of these categories is defined in 
great detail in the "contextual analysis" code included in Appendix 2. 

Figure 3 shows a function usage by rate comparison. It shows the 
percentage of usage of the seven functions under tte two conditions 
studied. It generally indicates little clear effects of rate on 
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Insert Figure 3 about here 



function usage. Some small differences are indicated but these are 
not statistically significant. The figure indicates that declaratives 
are the most frequently used function regardless of whether the subject 
is talking a lot or not. Answers are the second most observed function, 
then request-commands, and so on. This mean data is represented for 
the distribution for each of the 10 subjects analyzed. 

This analysis suggests that rate of talking had no real effect 
on the distribution of pragmatic functions utilized by the subjects. 
This finding would suggest that rate influences generalization and 
acquisition simply because of the number (practice effect) and 
diversity of opportunities. It means that the child will have to use 
language, not because it also presents a shift to more facilitative 
and useful pragmatic functions or even just to the use of more pragmatic 
functions . 

The Effects of Form Complexity on Function Use 

Another important variable that could effect generalization and 
acquisition of language is the relationship of length of utterance 
(i.e., form complexity) and pragmatic function use. Less complex 
(shorter) forms may tend to be used for a certain distribution of 
functions while longer forms might be used for another di str ibution- of 
functions. Such a finding might help explain the differential 
generalization of longer and shorter trained forms as reported 
previously. This in turn may help us structure language training to 
take advantage of naturally occurring complexity/function relationships. 

This analysis was designed to determine the effects of length of 
utterance (in morphemes) on the distribution of function. The null 
hypothesis was that the distribution will not be significantly 
different regardless of the length of utterances spoken. The analysis 
was conducted by comparing the function distribution of one word, two 
word, three word, and four word or more utterances. Figure 4-10 
displays this data for several basic functions: declaratives , ^ 
questions, answers, request-commands, response to mands, vocatives, 
and imitations. These figures show significant differences for one- 



Irsert Figures 4-10 about here 



word utterances as compared to longer utterances across five different 
functions: declarative, questions, answers, request-commands, and 
vocatives. These differences are highly statistically significant. 
These results demonstrate that one-word utterances are utilized for 
very different purposes from longer utterances. One-word long 
utterances are used primarily as answers and vocatives, relatively less 
often as declaratives, request-commands, and questions. However, 
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(li rf()njnc(»s bot:woon two-» throo-^, and roiir-word ut;t:(?ran(:os art? smaller 
antt not ii(:at1st leal l,y icjni f leant, 

The findings on one-word uttorancos aro not; surprlsinq in 1 i(|lit: 
of observations by devolo|)inent:al psychologists of normal language 
ac(iuisit1on (Moerk, 1977). The lacl< of differences betv^een two-, 
three- ^ and four^word utterances supports the tentative conclusion 
made previously that overall developmental mismatch is the most likely 
explanation for lack of generalization of longer utterances, not 
differential functions. Therefore, these data provide a form of 
convergent validity for the analysis of longitudinal generalization 
and the conclusions offered by us as to the reason for differential 
generalization across trained utterance length. 

Public S ch ool Transition Follow -Up 

A major research question of this project was to determine the 
success of language-delayed children who had been through the language 
treatment program in making the transition to elementary school. If 
they were successful it would suggest that the model we were using 
in treatment was sufficient and that auxiliary procedures would not be 
necessary. That is, the follow-up analysis served as a baseline by 
which the need for additional treatment could be determined. The 
intervention model we \^ere using represented a good application of the 
current state of the art in intervention technology. 

Follow-up analysis was made on 12 children who had made the 
transition from the Language Project Preschool to normal kindergarten 
programs. Six of these children were also followed into first grade, 
thus allowing us to examine a longer trend in their data. Three types 
of data were analyzed for all 12 children: 1) standardized test scores 
taken wfien the children were first enrolled at Language Project Preschool 
(LPP), at the end of LPP, after one year of publ ic school , and for 
six of the children, after two years of public school; 2) parent 
surveys of their performance, 3) teachers' surveys of their performance. 

Characteristics of the 12 subjects studied and their Peabody 
Picture Vocubulary Scores at exit and at the point of first follow-up 
(and second follow-up where applicable) are included in Table 6. 



Insert Table 6 about here 



The average Peabody mental age as it relates to chronological 
age is shown for the 12 subjects across three time frames in Table 7. 
These time periods are at program entry, at program exit, and after 
one year in kindergarten. In Table 8 tlie same data is presented for 
a subset of six students except data is also shown after two years of 
publ ic school . 



Insert Tables 7 and 8 about here 
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I Tables 7 and 8 clearly show a rather unfortunate trend in the 
Pe^body score data. At program entry subjects were, of course, well 
bel'Ow where they should have been, given their chronological ages. 
At^ program exit on the other hand they were way ahead, an average of 
almost 14 months ahead of their chronological ages. This suggests that 
the preschool intervention program had a profound effect on these 
children's skil;:>, at least as measured by the Peabody. However, one 
year later their mental age scores had dropped back down near their 
chronological ages. Of course they were still doing relatively well 
and were better off than at LPP program entry. But the trend then 
continues downward for those subjects for whom second year follow-up 
data was available. Now, however, they had dropped about two months 
below age level. Still not a bad score, but the trend is alarming. 
Unfortunately, due to termination of the grant, we were not able to 
do tracking at Year 3, which obviously would have provided some 
interesting information. > 

The parent and teacher survey data suggested a high degree of 
parent and teacher satisfaction with LPP, but some serious parent 
concern over treatment of their child in elementary school. This data 
is presented in detail in Appendix 3. All parents firmly believed 
their children made significant progress while enrolled at LPP. The 
teacher survey data suggests that many of the students were continuing 
to have some problems in public school, however, but that the group 
was generally performing satisfactorily. 

In summary, the transition data suggests that preschool language 
intervention is very effective but that either its effects are somewhat 
transitory or the public school environment is so bad that it 
eventually begins to retard the students' learning again. It could be 
that preschool language intervention succeeds in training a large 
amount of content in the child, which allows them to score better on 
the Peabody norms, which were initially developed on a population of 
non-preschool children. But, the effects of this headstart then begin 
to fade out, perhaps because the child has not actually learned a 
strategy that will allow them to efficiently learn new information in 
a non-remedial environment like a normal public school classroom. 
Objectives 2 and 3 in this project address the issue of strategy 
(in Objective 3) and public school requirements (Objective 2). 

Forms ard Function in Language Learning and Generalization: A 
Theoretical Model 

In the course of conducting the studies for Objective 1, we 
concluded that to ultimately do a meaningful analysis of form and 
function in language learning and generalization, a theoretical model 
is necessary. We have been working on such a model, which is presented 
below in the briefest method possible. It is more fully presented 
in two recently published articles (Rogers-Warren & Warren, 1981, 1983), 

The proposed model of language learning integrates stimulus and 
response class formation concerned with considerations regarding the 
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effects of contingencies of the natural environment. This model is 
presented in Figure 11. 



Insert Figure 11 about here 



The productive form of communication, an utterance or a speech 2 
act, is determined by four contributing forces: speaker's intention 
(what function is the utterance to serve in this immediate instance), 
the interactional context (social, cultural parameters of communica- 
tior instances; non-linguistic rules that govern selection of 
communication form); semantic knowledge of the speake.^ (here, 
primarily representational or knowledge of word meaning, but strongly 
related to concept or response class-based knowledge) and syntactic 
knowledge (use of rules or regularity in combining forms to refer to 
certain events or intentions). ^ This model assumes multiple causation 
for form, but that form primarily arises from function. The develop- 
ment of communicative competence is "coming to say the right things, 
at the right time, in the right way" (Ervin-Tripp , 1971). Right 
things corresponds to speaker intention and the first step toward 
competence is realization of intention. This means coming in contact 
with the basic environmental contingency: language controls the 
environment. .Intention may initially arise from the most basic of 
human needs: food, warmth, human contact. Through the natural 
contingencies of the environment (and often for the developmental ly 
disabled, from specific training), increasingly discrete needs are 
discriminated (for example, prefercrices for certain types of food, 
attention from certain persons, access to particular object^ or events 
that are stimulating or reinforcing). Thus, a vector model of 
communication causation for a very young child or devel opmental ly 
delayed individual beginning language training will reflect a strong 
intention vector and a weaker context vector. Minimal force will be 
exerted by semantic/syntactic knowledge. 



Intention in this context might be construed to mean the function, 
the reduction of need, a behavior with the purpose of mediating 
reinforcers, and so forth. It is not assumed that intention arises 
separately from environmental contingencies or learning history. 
A behavioral analysis is still assumed to be appropriate, but a 
short-hand designate was required to facilitate this discussion, thus, 
"intention" is used throughout this section. 

'Although somewhat traditional linguistic terms have been used to 
describe the semantic knowledge, syntactic rules, and context, it 
could be assumed that the processes associated with acquisition of 
these types of information are learning based. 

^The vector model borrows from mathematical models in which strength 
of a force exerted on one object by another is represented by lines 
of varying lengths corresponding to the relative strength of the force. 
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The contextual vector represented in Figure 12 reflects the 
individual's discrimination and responsiveness to the nonl ingui stic 
factors that affect communication. At first, these discriminations 



Insert Figure 12 about here 



may be quite basic: presence of a listener, and knowledge of basic 
interactional strategies such as establishing eye contact, turntaking, 
and focusing joint attention. With development or training progressively 
finer discriminations are made: who is the listener, what is the social 
context, what knowledge does the listener already share. To say that 
the speaker has knowledge of these factors does not necessarily imply 
that the speaker can specify or describe this knowledge. The speaker's 
behavior is coming under the control of increasingly complex stimulus 
conditions. Knowledge is expressed as performance cued by attention 
to social stimuli. The factors that are discriminated by a language 
deficient person are simpler and fewer than those that control competent 
adult communication. 

The discrimination and reinforcement processes underlying the 
development of stimulus control operate regardless of complexity of 
the stimulus event or how many stimuli affect the response. Discrimina- 
tion of simple stimulus conditions supports the development of basic 
communication strategies that are compatible with environmental 
contingencies and provides a basis for more complex discriminations. 
Discriminations of basic environmental conditions and speaker intention 
can occur separate from communication, but it is unlikely that the ^ 
reverse is true, at least beyond the earliest stages of communication. 

The vectors representing syntactic and semantic knowledge may 
function as a single system, but have been shown as two sources of 
input. Semantic knowledge has at least three levels: the ostentatious, 
pointing level of simple reference, the complex referential level 
which allows identification of classes of stimuli referred to by the 
same name, or allows a single stimulus to be called by many names _ 
(in other words, stimulus and response class formation) , and meaning 
that results from the combination of words and the relationship 
expressed by this combination. 

Intention and context (environmental stimuli and contingencies) 
shape the selection of forms to a relatively greater extent than 
knowledge of syntactic and semantic conventions. In early communica- 
tion, semantic meaning and context may not be differentiated (Bates, 
1976) and the task of the language learner may be one of discriminating 
and generalizing the relationship between forms and functions. 
Initially a single form occurs in a single context and context with 
form serves to convey a specific function. Subsequently, a second 
form occurs in the same context. The first response class may be 
formed by concluding that Form 1 and Form 2 in Context 1 convey the 
same function. For example, pointing to a cookie and saying cookie 
may both result in daddy providing a cookie, when father and child 
are near the cookie jar. If pointing subsequently works to get a 
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Figure 12 

VECTOR ANALYSIS FOR A YOUNG CHILD'S OR LANGUAGE DEFICIENT INDIVIDUAL'S COMMUNICATION 
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cookie from grandmother when she and the child are in the grocery 
store, it would seem likely that the child will correctly conclude 
that saying "cookie" would work equally well. Two contextual stimuli 
are responded to as if equivalent, and function (requesting cookies) 
may be conveyed by the use of either form. Of course, frequently 
contexts are not equivalent even though they may appear to be to the 
child. The task is one of discriminating the particular aspects of 
the context to determine which responses will function to convey 
intention or to mediate the behavior of others in a particular way. 
Forms that work better will be used because reinforcement increases 
the probability of the behavior it follows. The contingencies applied 
by the environment probably will be based on interpretabil ity of the 
response. "Cookie" will replace the gesture if it is more likely to 
result in a cookie than just pointing to it. By selecting words with 
more restricted or specific meanings and by using combinations of 
words in an orderly fashion, the child can specify particular 
intentions still better. Concurrently, the contextual conditions which 
are likely to affect how well an utterance works to achieve the desired 
goal will be discriminated at increasingly discrete levels. For 
example, tne importance of getting the listener's attention before 
verbalizing may be one of the first important contextual discriminations. 
In the preceding example, one of the first conditional discriminations 
may be among persons who are likely to provide cookies and those who 
are not, or the presence or absence of cookies. 

Errors language learning persons make in labeling and in syntax 
are logical ones, based on over- or undergeneral izing certain regularities 
between form and function at a variety of levels. Errors decrease as 
controlling aspects of the stimulus classes are discriminated and 
adjustments are made accordingly. 

All vectors should increase in length with communication training. 
Knowledge of syntax and semantics, sensitivity to environmental 
context, and elaboration of intention increase as the individuals 
learn new forms and as feedback from the environment strengthens their 
knowledge about the relationship between form and function. The 
vector model represents this dynamic and multidimensional process. 
At any given point, different typec of utterances may result from 
differing strengths of the component vectors, even to the extent 
that expression of different intentions are differentially impacted 
by the context and speaker's mastery of particular types of 
information. 

OBJECTIVE 2: To determine what specific language skills are required 
t o succeed in an elementary school classroom . 

This objective necessitated a large-scale assessment of the_ 
communication requirements inherent in the elementary school environ- 
ment To complete this objective we designed and conducted an 
analysis of aood and poor communicators in these classrooms, l he 
analysis included a study of teacher perceptions of these children, 
an analysis of the developmental levels of these children, and of the 
social and pragmatic asnects of their communication behaviors. We 
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found that teachers clearly perceive a range of differences between 
poor and good communicators, but that only part of these perceived 
differences has any apparent reality in terms of actual behavior. 
This set includes the specific linguistic skills of the children. 
That is, our observational and test scores analysis of the subjects 
indicated clear differences in terms of actual linguistic skills, but 
.few differences in terms of social usage skills. These results, 
combined with our findings in Objective 1, suggest that success in 
early elementary grades for the language handicapped child may depend 
on how much actual attention is given to effectively remediating his 
or her specific linguistic handicaps. The problem is to determine 
how to do this in the most effective, cost-efficient manner. This 
then has become the principal issue addressed by Objective 2. In 
this section we present the results of the large-scale group analysis 
that led us to this conclusion. 

The overall goal of this study was to develop an accurate descrip- 
tion of the good and poor kindergarten communicator. We were interested 
in (1) the accurate identification of these children, and (2) the 
specification of target skills to remediate in these children. We are 
not particularly interested in small differences between these two 
types of children. Our research involved observing good and poor 
communicators in their classrooms in both structured and unstructured 
situations, and observing a third group of randomly selected controls. 
We also collected Developmental Sentence Scoring (DSS) data and 
Metropolitan Readiness Scores on these children. Finally, we surveyed 
all the subjects' teachers across a variety of variables concerning 
the performance of these children. The specific hypotheses we posed 
were as fol lows : 

H.: The good and poor communicators differ significantly in terms 

, of their DSS scores . 
H^: The good and poor communicators differ significantly in 

terms of their responsiveness overall, and/or under specific 

conditions of structured/unstructured or. group size. 
H^: The good and poor communicators differ significantly in 

terms of frequency of speaking. 
H^: The good and poor communicators differ significantly in 

terms of frequency of initiation. 
Hr'- The good and poor communicators differ significantly on 

qual i tative dimensions of their speaking: distribution of 

functions . 

H^.: The good and poor communicators differ in frequency of 

teacher speech to them, 
H-,: The good and poor communicators differ in qualitative 

dimensions of how teachers speak to them: directi veness ; 

interrogatives ; conversational . 

Method 

Subjects and setting . Thirty-nine kindergarten children from 
13 classrooms participated in the study. One "good communicator" 
from each class was selected according to who appropriately demonstrated 
the greatest number of the following behaviors: 
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1) speak words clearly, using complete sentences; 

2) make verbal requests to meet needs; 

3) respond appropriately to questions, comments, and instructions 
of others; 

4) modulate voice volume and change expression, according 
to situation. 

One "poor communicator" was selected according to who demonstrated 
the fewest number of the preceding behaviors. One "control" student 
was selected by picking a name from a bag containing the names of 
all the children in the class. None of these students received special 
education services. 

Ages ranged from 5 years, 5 months to 6 years, 6 months with a 
mean of 5 years, 11 months. Seventeen boys and 22 girls were selected, 
which included 33 Anglo-American, and 6 non-Anglo-American children. 
(Detailed descriptions of the individuals in each of these groups are 
presented in Table 9-11). 



Insert Tables 9, 10 and 11 about here 



The study was conducted in 13 kindergarten classrooms within the 
Lawrence Unified School District, Lawrence, Kansas. Observations 
were taken when the subjects were in both structured and unstructured 
settings. A structured setting consisted of the teacher being present 
and guiding the learning activities of a small group of children. 
Usually the teacher gave directions to the group, and then gave 
individual instruction and feedback to individual members of the group. 
Reading, math, and art lessons were most frequently taught in these 
small group situations. 

An unstructured setting us'.jally consisted of a small group of 
children working independently on teacher-assigned activities. The 
students were free to interact quietly, and the teacher or an aide 
sometimes stopped by to give occasional feedback on the children's 
work and/or further instruction. The students usually participated 
in art and supplementary reading and math activities during unstructured 
time. 

Procedures 

A brief overview of the study was presented to all district 
kindergarten teachers at a regularly scheduled kindergarten teachers' 
me-eting. Those teachers who volunteered to participate listed on a 
survey the names of three children in their classrooms who could be 
classified as "good communicators" and three others who could be 
classified as "poor communicators". Then the teachers listed the 
behaviors exhibited by these children to explain their choices. 

Next, the teachers were given the criteria (see Subjects ) for 
good and poor communicators which had been developed by a group of 
experts from the University of Kansas in the area of language and 
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communication. The teachers then selected three children from their 
class who exhibited the greatest number of these behaviors and three 
children who exhibited the fewest number of these behaviors. A 
comparison was then made between those children chosen with and those 
chosen without using the specified criteria. 

Three different types of data were collected for each subject. 
The first was a verbatim language sample taken while the subjects were 
participating in the unstructured group settings. Observers sat close 
to each subject and wrote 50 audible sentences. These sentences v^ere 
then scored according to the procedure described by Lee (1974) for 
evaluating children's syntactic development. A sentence was defined 
as the occurrence of a noun and a verb. Eight categories of grammatical 
forms were selected by Lee (1974) as showing the most significant 
developmental progression in children's language: 1) indefinite 
pronoun or noun modifier, 2) personal pronoun, 3) main verb, 4) secondary 
verb, 5) negative, 6) conjunction, 7) interrogative reve.'^sal in 
questions, and 8) wh-questions . A specified number of points was given 
to words fitting these categories, depending on which of seven develop- 
mental levels it fit. Credit was given only when a sentence met all 
the requirements of adult standard English, and this included syntactic, 
morphological, and semantic conventions. The total number of points 
was divided by the number of sentences, resulting in a developmental 
sentence score (DSS). 

For the second type of oDservation, a code describing various 
language behaviors of teachers and kindergarten children was developed 
and field-tested in two of the classroonis in the study. The code 
defined the following: 

Declarative: statement to share information 

Yes-No Question: a question that may be answered by yes or no 

Mand: verbalization that requires a verbal response 

(Example: "Tell me v/hero you live-") 
Command: demand for a nonverbal response 

(Example: "Hand me a crayon.") 
Vocative: verbalization calling 1 istener * s attention to something 

in the environment 

(Example: "Look!**) 
Correction: utterance intended to correct inappropriate answer 

or behavior 

(Example: Teacher: "What color is this?" 
Child: "Yellow." 
Teacher: "No, green.") 
Question: verbalization in which speaker seeks information from 
others 

(Example: "Where's my pencil?") 
Answer: verbalization that supplies information in response to 
another speaker's question or request 

(Example: "Where's my pencil?" Answer: "On the floor.") 
Nonverbal Compliance: the subject complies within 5 seconds of 
being given an instruction 

(Example: "Put your finger on the yellow ball." 
Student: tries within 5 seconds) 
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Nonverbal Non-Compliance: the subject does not comply within 

5 seconds of being given an instruction 
Unintelligible: a verbalization that cannot be understood 
Other: an utterance that does not fit any of the preceding codes 

Three graduate students and one undergraduate student served as 
observers. Practice using videotapes of kindergarten children 
interacting with their teacher, a written test, and practice observa- 
tions in two of the classrooms was used to reach a minimum of 70?^ 
reliability with the research assistant who supervised the study. 

The observers sat as close as possible to the subject without 
interfering with the group activities but still able to hear spoken 
utterances. Each child was observed on at least two separate occasions 
for 15 minutes in both structured and unstructured settings (totaling 
30 minutes of structured and 30 minutes of unstructured time). Teacher 
and peer verbal behaviors were recorded when they were directed at 
either the subject or the entire group in which the subject was a 
member. 



Each behavior was recorded in sequential order for 50 seconds of 
each minute, and the final 10 seconds were used as "catch up" time. 
Stopwatches were used to keep track of the minutes. If the subject 
left the group, the observation was discontinued until the child 
returned, and the timing resumed from the point it had been stopped. 

The third type of data analysis included each child's stanine 
scores on the Metropolitan Achievement Test given in April. These 
scores were included to see if there was any correlation between the 
scores and the teacher ratings of the good and poor communicators. 
Stanine scores from the following areas were included: auditory, 
visual, language, pre-reading, and quantitative. 

Rel iabil ity 

Interobserver reliability was calculated by having a second 
observer make simultaneous, but independent, observations with each 
observer. Two reliability observations were taken with two observers 
and three were taken with the third observer, totaling seven. 

Two types of reliability measures v;ere calculated. Overall 
measurement of reliability of the number of simple occurrences of 
coded behaviors was calculated by the formula: 

0 

Reliability - number of agreements of occurrence w .^n. 
number of agreements + number of 
disagreements of occurrence 

A second reliability measure was calculated on the categorical 
agreement of the utterance, or how each utterance was coded. The 
formula used was: 

Reliability - number of agreements on all categorie s w 
number of agreements + disagreements on 
all categories 

Overall code reliability was 87%. 



46 



Resul ts 

The DSS analysis significantly distinguished the good from the 
poor communicators. The Metropolitan distinguished the poor group 
either from the good group or both the good and control group on the 
following dimensions: auditory discrimination, visual discrimination, 
language, reading readiness, and quantitative skills. These results 
are summarized in Table 12. Teachers clearly distinguished the 



Insert Table 12 about here 



good communicators from the poor communicators on several dimensions: 
makes verbal requests, follows in, tructions , responds appropriately to 
questions, uses complex sentence structure, length of attention span, 
reading readiness, use of complete sentences, and speaks clearly. 
Of these, the DSS or Metro data strongly supported these discriminations: 
uses complex sentences and reading readiness. Strong support was 
not obtained for the other distinctions made by the teachers based on 
behavioral observations of the subjects in classroom interactions with 
peers and teachers. The teacher questionnaire data are summarized in 
Table 13. 
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Discussion 

The results suggest that the greatest differences between good and 
poor communicators lie along linguistic and cognitive dimensions. 
Social differences in terms of the language usage of the subjects may 
exist, but did not significantly distinguish the subjects in this 
study. These results suggest that language remediation efforts should 
focus most heavily on the structural aspects of communication and 
relative cognitive and perceptual skills with children demonstrating 
below average communication skills in the absence of more general 
handicapping conditions. 

OBJECTIVE 3: To develop auxiliary language training procedures to 
teach specific skills t y pically required in school 
settings . 

The results of our research on the first two objectives and^^our^ 
own research as part of this objective has suggested to us that "milieu' 
language teaching strategies may be the most cost effective approach 
for supplementing traditional language intervention. This approach 
has been shown to have a large impact on both the linguistic and social 
aspects of children's communicative behavior. Furthermore, it can be 
implemented by both parents and teachers under the supervision of a 
therapist or trainer. Milieu strategies are basically a set of 
techniques to be used incidentally with a child throughout the day, 
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both at home and school. They can be tarqett)d on a wide range of 
linguistic and social skills. The techniques include incidental 
teaching, time delay, and the mand-model procedure, Most of the re- 
research by us and others (principally Betty Hart, Todd Risley, and 
Jim Halle— all of whom we have had a great deal of interaction vnth 
throughout the course of this research) has been classroom-based so 
far. 

In this section we will present the results of four studies 
which, combined with results of our research for Objectives 1 and 2, 
have led us to conclude that a milieu teaching strategy approach 
is the most cost effective route. Two of these studies suggest the 
relative ineffectiveness of two other approaches, direct social skill 
instruction and reverse mainstreaming . The other two studies examined 
the effectiveness of milieu training approaches. One of these 
utilized classroom trainers and the other parents. The results of all 
four studies are presented below. 

Teacher and Normal Peer Interaction with Language-Delayed Preschool 
Chil dren 

The topic of mainstreaming has become a focal one among educators 
of handicapped children during the past several years. A primary 
assumption of the mainstreaming movement is that the handicapped child 
will benefit from observing and interacting with normal children in 
the mainstreamed classroom. Although research has been increasing, 
the bases for mainstreaming have relied more on theoretical assumptions 
than on empirical research. The purpose of this study was to investigate 
some questions concerning the effects of mainstreaming on the productive 
verbal behavior of language-delayed preschool children and their non- 
handicapped peers in a mainstreamed classroom. We were specifically 
interested in the following questions: 

1) How do normal and language-delayed preschool children compare 
in cerms of their respective verbalization rates, their rates 
of spontaneous speech initiation, and their responsiveness 

to questions from peers and teachers? 

2) How do teachers respond to the two types of children in terms 
of their rates of instructions, questions, and total 

verbal izations? 

3) How do normal child models compare to other normal children 
not in a mainstreamed classroom in terms of their relative 
ratios of peer-to-teacher interaction? 

These questions were investigated in a study of 10 language- 
delayed preschool children who were mainstreamed in a classroom with 
five normal models. Five normal children from a regular non-ma instreamed 
classroom were also observed in order to contrast the behavior of the 
normals in the mainstreamed classroom to normals in a traditional 
classroom. All 20 children were matched for age with a mean of 3 yr, 
10 months. The language-delayed children all showed up on a battery 
of standardized language assessments as having speech delays averaging 
about 1 yr below their age levels. All 20 were observed for 10 
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l5-iirin periods across 3 months. The; obs(3rvations were taken while the 
children wore involved in a freeplay period with a teacher-pupil ratio 
of 1 to 5. The observation code measured child verbalizations to 
peers and teachers with a sub-category for spontaneous initiations 
and verbal responses to questions (non-prompted) and also measured 
questions, instructions, and total verbalizations by the teachers 
in both the mainstreaming classroom and the traditional classroom. 

Not surprisingly, the normal models in the mainstreamed classroom 
displayed much higher rates of spontaneous initiations and total 
verbalizations than the language-delayed children as shown in Figure 13. 



Insert Figure 13 about here 



The language-delayed children also responded to questions from 
their teachers at a much lower percentage of time compared to their 
normal peer models (i.e., less responsive in obligatory speech 
situations) as shown in Figure 14. However, rates of teacher verbaliza- 
tions to both types of children in the mainstreamed classroom were 
very similar in terms of their total verbalizations, questions, and 
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instructions to each group. Further, these rates were very similar 
to the rates displayed by teachers in the normal children's classroom. 
Also, the normal children in the traditional classroom displayed 
rates of verbal behavior very similar to the rates disp^ajlyed by the ,V 
normal models in the mainstreaming classroom. But an important 
difference was found between the verbal behavior of the mainstream 
models and their counterparts in the traditional classroom. This 
difference is displayed in Figure 15. It shows that the normal children 
from the traditional classroom directed a far greater percentage of 
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their total verbalizations to their peers than did the language 
delayed or normal children in the mainstreaming classroom. The 
children in the mainstreaming classroom interacted much more with 
their teachers than with each other compared to the children in the 
normal classroom during the freeplay periods observed. 

The mainstreaming model examined here has been characterized by 

educators as "reverse mainstreaming " the presence of normal 

children in a classroom primarily made up of handicapped children. 
Contrary to the hopes and expectations of advocates of this model, it 
may have some effects in reverse of those intended, however. The 
assumption that normal children serve as important models for 
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The Effects of Soci a l Ski l l Trai n i ncj_ ori^ the Socj a 1 In tera^t ion Beha v 1 or 

An experimental attempt was made to train specific social sl<ills 
to four language-delayed preschool children. An observational code 
was utilized to measure a number of child and teacher behaviors. A 
copy of this code was included in the February 1981 progress report. 
In the following summary we will be presenting data on the rate of 
invitations to joint activity to peers, the percent of intervals in 
which each child engaged in cooperative play, questions and comments 
to peers, overall utterances to the teacher, and overall utterances to 
peers. These represent the critical subset of behaviors measured by 
the code. 

Generally, the four children involved in the study had been found 
to have depressed rates of social behavior corresponding to their 
delayed speech. We attempted to teach a joint-activity game to each 
subject within a multiple-baseline design with a reversal condition 
included. The experimental conditions were: baseline, joint-activity 
game, joint-activity game with teacher prompts, reversal, and joint- 
activity game with prompts again. Within the context of the game 
format, invitations to joint activity were trained with a common 
communication game format. That format was as follows: The four 
subjects are divided into two play groups with two other peers in each 
group (4 children per group). These play groups meet daily for 8 
minutes and played with a common manipulative material (e.g., blocks, 
lego, etc.). During the first 4 minutes, one target subject and one 
peer played the communication game with a teacher. At this time the 
teacher instructed them in the target behavior in the context of tho 
game. At the end of 4 minutes the game is stopped. All four children 
were then free to play with the materials in anyway they wished for 
the remaining 4 minutes. This period allowed an analysis of generaliza- 
tion. In addition, sometimes the group met with an unfamiliar teacher 
supervising to further facilitate an analysis of generalization. 
The subjects became very proficient at the game during the initial 
4-minute period. 
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The results of this study revealed no generalization of the 
invitations to joint activity occurred outside the game time until 
teacher prompts were given. In this condition, dear effects 
occurred for three of four subjects and minor effects for the fourth 
(i.e., Darrell). Reversal control showing the efficacy of the prompts 
were obtained for three of four subjects also (all except Rick). In 
other words, generalization of the invitations to joint activity to 
peers were dependent on teacher prompts in the freeo'^ay period 
immediately following the 4-minute game playing time. However, clear 
effects of the game with prompts in the generalization setting were 
seen in terms of the cooperative play behavior of all four subjects. 
No interpretable or cl ear effects were obtained for any subject in 
terms of their questions and comments to peers > utterances to teacher, 
or utterances to peers in the generalization setting immediately 
following the game. 

This study demonstrated that we could get generalization of 
invitations to joint activity and cooperative play interactions by 
language-delayed preschoolers in a freeplay situation, but only if 
we used teacher prompts for the behavior in the generalization setting. 
In our opinion, this finding does not support this approach as an 
especially strong technique for facilitating peer interaction. On 
the other hand, finding ways to really increase peer interaction 
among preschool children has proven to be an exceptionally difficult 
task. Many researchers have attempted it, and almost no wholly 
satisfactory techniques have been reported. At the minimum, this study 
demonstrated a technique that will work if teacher prompts in the 
generalization setting are included. And teacher prompts certainly 
represent a relatively mild low-cost effort. Also, the target behavior, 
invitations to joint activity, is clearly a cornerstone to the 
development of good social -interact ive behavior. Therefore, this 
technique is probably worth utilizing. On the other hand, other 
approaches might be more cost-effective, particularly those that can 
be individually designed to meet the needs of each child. 

The Effects of Teacher Mands and Models on the^Spee ch of Unresponsive 
Language-Delayed Children . 

A number of research studies have investigated the effects of 
"in vivo" or "incidental teach"*'^n" approaches to language remediation 
(Hart & Risley, 1980), In con" to traditional speech therapy 
models, these procedures are a( }d in the child* s everyday environ- 
ments and can be (Utilized by tec ^ers, parents^ and other adults. 
Hart and Risley (1958, 1975, 1980) have published a number of studies 
reporting positive outcomes of incidental teaching on the productive 
language usage of socio-economically disadvantaged preschool children. 
In these studies, incidental teaching procedures were used whenever a 
child initiated (verbally or nonverbal ly) an interaction by specifying 
a reinforcer (attention, access to a material or activity) that 
an adult could deliver. Prior to delivering the reinforcer, the 
adult focused attention on the child and asked for elaborated language 
related to the topic the child specified. In this way, the adult 
required specific language forms or functions from the child, and 
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taught simple or elaborated language under highly functional and 
reinforcing conditions. Utilizing this approach, Hart and Risley 
have reported success teaching the functional usage of color noun 
cofiibinat ions , nouns, compound sentences, descriptions of materials 
(adjectives), as well as in increasing overall language use beyond 
the specific language behavior targeted (Hart & Risley, 1980), 

Hart and Risley (1980) have argued that differentially attending 
to the child's initiations and responding relative to the child's 
selected tooic substantially increased their subjects' probability 
of talking. This in turn appeared to facilitate the unanticipated 
general effects they reported as a result of incidental teaching. A 
significant variation of the incidental teaching approach was 
recently reported by us (Rogers-Warren & Warren, 1980). Working with 
language-delayed children who were concurrently receiving traditional 
one-to-one language training, we instructed classroom teachers to 
approach children and request verbal behavior through the use of mands 
(instructions to verbalize) and models (imitative prompts). Thus, the 
number as well as the efficacy of teaching opportunities was controlled 
by the teacher. This approach violated one basis of incidental teaching— 
the determination of topic (reinforcer) and initiation of the interaction 
by the child. However, it allowed a teacher to apply the other 
components of incidental teaching with children who had very low 
initiation rates and who were unlikely to encounter the child-inititated 
incidental teaching procedures. The results of the study showed 
increased subject verbalization rates, increased responsiveness in 
obligatory speech situations, and increased generalization from one- 
to-one language training to the classroom. These findings suggest the 
mand-model procedure could have many of the same effects as incidental 
teaching and niore importantly, be applicable with socially isolate 
children. But we did not investigate the effects of the procedure 
on the subject's non-obligatory speech (initiations), the effects of 
withdrawing the procedure, or generalization of the effects to other 
settings . 

Since adults control the number and efficacy of teaching opportun- 
ities in the mand-model procedure, it seems plausible the procedure 
would mitigate against increases in child initiation rates. When 
treatment is withdrawn, the subjects might return to low rates of 
interaction and again become unresponsive to the speech of others. 
It is conceivable that the procedure might have no effect on the verbal 
behavior of the subjects under nonobl igatory speech conditions, or in 
another setting altogether. Therefore, in the present study the 
rates of nonobl igatory speech (verbalizations not preceded by adult or 
peer speech to the subject) and the responsiveness of the subjects to 
initiations from others during a freeplay period were directly measured 
as outcomes of a "mand-model" procedure implemented in a multiple- 
baseline design across three unresponsive, socially isolate language- 
delayed preschool children. Both the subjects and the teachers were 
frequently observed in a second freeplay setting to determine the 
extent of generalization resulting from the intervention. The effects 
of requiring two different minimum sentence response lengths from the 
subjects on the mean lengths of their speech utterances were also 
measured. 
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After an initial baseline period, teachers were instructed to 
1) present approximately 10 mands per 15 minutes to each target 
child; 2) provide models when subjects failed to respond appropriately 
to the mands; 3) provide feedback for appropriate child responses to 
niands and models during the initial classroom freeplay period of the 
day. Generalization of the intervention effects was measured during a 
second freeplay period held later in the day. Following a lengthy 
intervention condition, experimental procedures were systematically 
faded out. Results of the experiment are shorn in Tables 14 and 15 
and Figures 15, 17, and 18. 



Insert Tables 14 and 15 and Figures 15, 17, and 18 about here 



Experimental control was demonstrated over the target teacher 
behaviors, mands and models, throughout the experiment. Rates of 
mands and models were dramatically increased, held relatively constant 
across the intervention phase, and then gradually decreased to baseline 
levels (or near baseline levels in Lisa's case) during the programmed 
fading condition. Large increases in total teacher verbalizations 
also occurred with the implementation of the intervention and these 
rates maintained during the fadeout condition. These rates reflected 
an unscheduled increase in teacher questions as well as the planned 
increases in mands and models. Furthermore the maintenance of total 
teacher verbalizations appeared largely attributable to further 
increases in teacher question rates during the fadeout condition. 

Significant increases in total child verbalizations occurred 
during the implementation of the intervention, generalized to the 
second freeplay setting, and maintained throughout the experiment. 
Increases in the subjects' non-obligatory speech responses (initiations) 
also occurred although the effects vjere somewhat limited for Lisa. 
Generalization and maintenance of these effects were also observed 
in the second freeplay setting. Lisa and Debra both became much more 
responsive in obligatory speech situations as soon as the intervention 
was initiated. This effect generalized and continued throughout the 
experiment. Tom, who was already relatively responsive in baseline, 
became somewhat more responsive in the intervention setting throughout 
the experiment but displayed no generalization. 

A primary experimental question concerned the effects of the 
fadirg condition. As the mand-model procedure was faded out, Tom 
and Debra actually became more verbal in the intervention setting and 
marked increases occurred in their rates of non-obligatory verbaliza- 
tions in this setting. The treatment effects maintained for Lisa but 
no increases occurred. However, the fadeout also revealed an 
interesting effect with the teachers. They maintained their overall 
interaction rates with the subjects in the intervention setting during 
this period essentially by increasing their rates of questions even 
further. That is, when told to decrease their use of mands and 
models, they complied by making a topographical shift from the mand 
forms to the question form. This raises an interesting issue about 
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the efficacy of the questions. Could the sarru' results be obtained 
just be increasing rates of teacher questions? 

Like incidental teaching, the mand-model procedure both focuses 
the attention of the teacher on the child and gives the teacher a 
strategy to elicit and shape the child's speech. The effects of 
niands, models, and questions is to demand speech from the child. 
The difference between these forms 'is a matter of directness. Models 
are most explicit in that they actually provide the child with the 
response. Mands are next because of their imperative "command" 
nature. Question forms are least explicit because they are often 
ambiguously presented in terms of appropriate child response and 
inherently less directive than mands and models. But they are also 
a much more normal conversational form while mands and models may 
seem somewhat unusual in normal adult-child conversation. This "demand 
continuum" reflects itself in child responsiveness. As reported, 
models are most frequently responded to , then mands (66;0» ^nd 

then questions (5rO • 

When utilizing the mand-model procedure it is not surprising that 
teachers would also ask more questions because (1) their attention 
has been focused on the child, and (2) questions are not too different 
in form and function from mands and models. But when told to stop 
using the mand-model procedure the teachers did not reduce their 
interaction rates with the subjects but simply increased questions even 
more. Given the increased rates of questions, what were the independent 
effects of the mands and models? The main effect was probably on the 
responsiveness of the subjects. During baseline, when no mands and 
models were given but questions were (mean rate of 7.5 per observation), 
Lisa was responsive to only 15% and Debra to 24%. So the explicit 
imperative nature of the mand-model procedure probably made the 
subjects more responsive. Once their responsiveness reached near normal 
levels then it v/ould appear, on the basis of the fadeout data, that 
questions were sufficient to maintain responsiveness and high interac- 
tion rates between teachers and children. Nevertheless, a component 
analysis in which just teacher question rates are first increased may 
be warranted in a future study. 

A concern of the investigators prior to the experiment was that 
the mand-model procedure could make a child verbally responsive but 
not verbally initiative because it is adult controlled in contrast to 
incidental teaching. Given that the subjects were socially isolate 
such an effect might represent a severe limitation on the therapeutic 
potential of the procedure. This did not prove to be the case. Tom 
and Debra 's non-obligatory verbalization rate in the intervention 
setting increased over baseline and then increased further in 
correspondence with the fadeout condition to levels similar to their 
normal peers. Some increases also occurred for Lisa during the 
intervention but her fadeout levels dropped slightly to a level still 
above her baseline. The intervention effects generalized and maintained 
for Debra and Lisa, but not for Tom. 

The intervention setting and generalization data suggest the 
mand-model procedure stimulated the "response class of language" in 
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general (Hart & Risley, 1980) and thus, like incidental teaching, 
produced some general effects on language usage. These results along 
with those of Hart and Risley (1968, 1975, 1980), and Halle, Marshall, 
and Spradlin (1979) suggest that it doesn't necessarily matter how 
children's rates of interaction is increased (i.e., by incidental 
teaching, mand-model , or time-delay), because once it is, general 
and often unanticipated changes in language use will occur. 

Despite its positive effects, the results of the fadeout suggest 
the procedure should be faded out and perhaps replaced by an incidental 
teaching format (i.e., child initiated) once the child is responsive 
and talking at an acceptable rate. The evidence for this is zhe 
increases in total verbalizations and non-obligatory verbalizations 
displayed by Tom and Debra in the intervention setting corresponding 
with the fading procedure. These suggest that the adult-initiated 
format of the mand-model procedure might tend to place a ceiling level 
on verbalization rates. Another factor to be considered is that the 
procedure does not represent a typical way of interaction, which may 
mitigate against its effectiveness after initial positive effects 
have been realized. However, the experimenters v/ould recommend that 
the procedure not be withdrawn until substantial stable effects are 
evident (near normal child levels if possible) and some across-setting 
generalization has been obtained. Furthermore, the fading procedure 
should proceed on the basis of evidence of maintenance, not by a 
predetermined schedule. 

The MLU data are intriguing also. MLU is widely considered as a 
valid indicator of the complexity of young children's speech (Dale, 
1976; Moerk, 1977). Changes of .5 are usually considered to represent 
important developmental advances by the child (Brown, 1973). There, v/as 
little or no increase in any subject's MLU until the two-word response 
requirement (B2) was added to the intervention. Then, for the remainder 
of the intervention condition Tom's MLU increased .4 (over 12 weeks), 
Debra's .5 (over 8 weeks) and Lisa's ,3 (over 16 weeks). Furthermore, 
subject's MLUs continued to increase during the fading condition so 
that by the end Tom's MLU had increased .8, Debra's .7, and Lisa's .5. 
Were these increases the result of the intervention and the increased 
sentence length requirement or simply maturational bursts? It is not 
possible to determine the answer from this study. However, these data 
parallel data on the general effects of incidental teaching that Hart 
and Risley (1980) have reported. At the minimum, these findings suggest 
the need for studies in which different minimum word length utterances 
are required in response to mands with a design that allows for valid 
control group comparisons. 

The mand-model procedure was designed as an alternative to the 
Hart and Risley incidental teaching procedure for use with children 
who are socially isolate or low rate speech initiators, which is a 
common problem among more severely language delayed or mentally 
retarded children (Schiefel busch , 1981), Previous research (Rogers-Warren 
& Warren, 1980) has shown the procedure increased child verbalization, 
responsiveness, speech complexity, and generalization of newly trained 
language. The present study replicated many of these effects and 
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presents nev/ data on teacher question rates, the child's non-obligatory 
speech, and differential responsiveness. Furthermore, data indicating 
the across-setting generalization and maintenance of child verbaliza- 
tions, non-obligatory speech, responsiveness, and teacher verbalizations 
and question rates was presented. Finally, data on changes in child 
ML) and data demonstrating that the procedure can be successfully faded 
out with durable results were shown. The sum of this data suggests 
the mand-model technique facilitates many of the specific and general 
effects also reported to result from incidental teaching. It is 
suggestGd that it be used as a means of establishing initial stable 
rates of child speech and responsiveness and that the locus of control 
then be shifted from the adult to the child as in the incidental 
teaching model . 

Training Parents to be Incidental La nguage Trainers 

In reviewing the relevant literature we noted a consensus among 
professionals that parent language intervention is critical for 
improving generalized language skills in handicapped children. Far 
less agreement existed, however, concerning cost-efficient and 
effective methods for training parents, the content of training or 
procedures for quantifying changes in parents and child behavior. 

In considering what strategies to train parents to use, our 
attention was drawn to the experimental literature on incidental 
teaching strategies. In these studies, incidental teaching had been 
applied by trained teachers and staff members. Extension of incidental 
procedures for use by parents seemed appropriate for several reasons. 
Three procedures had been specified sufficiently to be adapted easily 
for use by parents. They included: (1) Incidental Teaching, which 
had been developed and empirically validated in several studies by 
Hart and Risley (1968, 1974, 1975, 1980); (2) the Mand-Model Procedure, 
described and studied by Rogers-Warren and Warren (1980); and (3) 
>Time Delay, which had been examined in two studies by Halle and his 
colleag.es (1979, 1981). 

A primary reason supporting the use of incidental teaching proce- 
dures by parents is that the procedures can be applied in naturally 
occurring situations. If parents are trained to view most any 
situation as a potential language activity, they can apply the proce- 
dures vyhenever they have the inclination and time to do so. Furthermore, 
by teaching parents to use the procedures in a variety of situations 
and in a variety of settings, generalization can be actively programmed. 

A second reason supporting the use of incidental teaching 
procedures by parents is that the procedures focus on teaching children 
about the functions of language. Traditional language training, 
conducted by the speech clinician in a therapy setting removed from 
the natural environment, has typically focused on teaching syntax or 
the structure of language. Oftentifties the content being trained, as 
well as the functions trained were not easily generalized to non- 
training settings. In addition, traditional language therapy often 
utilized discrete trial training in which the child was taught to 
respond to specific stimuli presented by the clinician. In contrast 
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to traditional language therapy, incidental teaching places primary 
emphasis on teaching the functional use of language. And, as the 
child's ability to use language functionally improves, increasingly 
more sophisticated means of expressing those functions are trained. 
Generalization of chil d skil 1 s is actively programmed by teaching the 
functio ns of language in a vareity of situations and settings. 

A third reason for use of incidental teaching by parents is that 
the procedures focus on building conversation skills. Whereas tradi- 
tional language therapy trained responding to individual and oftentimes, 
unrelated stimuli, incidental teaching procedures are designed to 
build conversational skills, including: initiating language in 
addition to responding to verbal or nonverbal stimuli; turntaking; 
establishing joint attention prior to initiating language; ^raining 
elaborated language about particular topics; and increasing length 
of conversation about particular topics. 

This study involved six mothers and their language-delayed pre- 
schoolers. In a multiple-baseline design across dyads, mothers were 
taught to use four incidental teaching techniques. The purpose of the 
study was to evaluate mothers' abilities to correctly apply the 
techniques and also to assess the effects of the techniques on child 
language. 

Arranging the environment . Before training mothers to use the 
procedures, they were trained to arrange the environment to facilitate 
talking by their children. This sequence of training was followed 
because the mother's ability to arrange and control materials in the 
environment is critical to her ability to effectively apply the proce- 
dures. During training in environmental arrangement, mothers learned 
to program for successful teaching interactions by selecting activities 
that are appropriate for the child's interests and skill level. Mothers 
were also trained to select activities that are conducive to use of 
the training procedures. Activities that are conducive to use of the 
procedures are those involving materials which can be manipulated 
by the child and which have a variety of attributes that can be 
discussed. Mothers were also trained to increase requesting behavior 
by the child by arranging materirils in the environment so that they 
are visible to the child but out of his or her reach, and by adjusting 
materials such that the child would need to request help to open them, 
attain them, work them, and so on. Mothers also learned to control 
materials so that only those items being used at the moment are avail- 
able to the child. Other materials are removed so that they won't 
distract the child from the task at hand. Finally, mothers were taught 
to withhold parts of materials from the child while eliciting language, 
and then to immediately give the material to the child contingent 
upon language responses. 

The incidental teachin g t echniques . The four incidental teaching 
techniques which the mothers"! earned were: (1) the Model Procedure, 
(2) the Mand-Model Procedure, (3) the Delay Procedure, and (4) the 
Incidental Teaching Procedure. The techniques were trained in the 
order specified above for two reasons. First, the child-goals of each 
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technique facilitated teaching the child-goals of the next-trained 
technique. Second, the steps of each procedure are cumulative. For 
example, learning the steps in the Model Procedure would facilitate 
learning the slightly more complex steps in the Mand-Model Procedure. 
The decision to train all four procedures was made because each 
technique targets different language goals for the child. In addition, 
the techniques are differentially more suitable in different situations. 
By training several techniques, parents can choose which is the most 
appropriate to use in particular situations. And finally, the variety 
of stimuli to which a child may linguistically respond may be increased 
by training parents to use several different techniques. 

The first procedure trained was the Model Procedure, The Model 
Procedure is the simplest of the four techniques, and the other 
techniques build upon it. The decision to train mothers to use the 
Model Procedure was based on the underlying theme of using the techniques 
to program for success by the child. Use of open-ended mands such 
as "What are you building?" or "What is it called?", will probably 
result in failure for children with limited expressive vocabularies, 
•ho Model Procedure programs for success, however, by providing the 
'^ponse for the child to imitate. If, after two models, the child 
-;0s not give the correct response, corrective feedback is given and 
the interaction continues. In order to prevent teaching interactions 
from being aversive to the child, the Model Procedure, like the other 
procedures, is designed to be brief and positive in nature. 

The primary child-goals of the Model Procedure are: (1) to 
establish a basic vocabulary; (2) to train generalized imitation; and 
(3) to train a strategy for incidental learning of vocabulary. Other 
child-goals of t'he Model Procedure, as well as the remaining three 
procedures, are establishing joint attention as a cue for verbalization 
and training turntaking skills. 

The second procedure trained was the Mand-Model Procedure. The 
Mand-Model Procedure is u^ed to elicit information which the child 
already knows or is likely to know. This information may have been 
trained using the Model Procedure. If, after onef or two mands, the 
child has not given the appropriate response, the adult goes into the 
Model Procedure and presents the response for the child to imitate. 
Verbal praise plus an expansion of the child's response follow correct 
responses. Corrective feedback consisting of the desired response, 
and when appropriate, praise for attempting the response, follow 
incorrect responses. The major chi 1 d-goal s of the Mand-Model Procedure 
are: (1) to train responding to a variety of adult-presented cues, 
and (2) to train the child to provide upon request, information he or 
she already knov/s. 

The third procedure trained was the Delay Procedure. The Delay 
Procedure is used to train the parent to allow the child time to 
initiate communication about needs, wants, or environmental stimuli. 
Thus, unlike the Model and Mand-Model Procedures, in which the adult 
verbally elicits language from the child, the Delay Procedure teaches 
the adult to ref ra in from talking in order to afford the child an 
opportunity to initiate an interaction. 
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Implementation of the Delay Procedure begins with one or two 
delays by the adult. The delays serve as a cue for the child to 
verbalize. If the appropriate response does not follow a delay, the 
adult has the option -oing directly into the Model or Mand-Model 
Procedure as a means f . : : iting the target response. 

In terms of chi id-goals, the Delay ">x}cedure is primarily used 
to train the child to initiate verbal interactions about environmental 
stimul i . 

The Incidental Teaching Procedure is trained last. This procedure 
simply requires using the three previously trained procedures in a new 
situation. Whenever the child initiates^^a request or a command (and 
in so-doing, specifies a reinforcer), the adult elicits ore complex 
or elaborated language from the child by following up the request/command 
with their the Model, Mand-Model , or Delay Procedure. 

The child-goals of the Incidental Teaching Procedi.^r are: (1) to 
build requesting behavior; (2) to train elaborated language about 
particular topics; and (3) to increase the length of con /ersation about 
particular topics. 

Training procedures . Training of each technique occurred in the 
clinic and consisted of: a lecture explaining the technique; a video- 
tape showing the trainer using the technique individually with three 
children (one of whom was the parent trainee's child); and a written 
handout describing highlights of the target technique. During the first 
training session at the home, the trainer modeled use of the technique 
with the child and then gave feedback following practice of the 
technique by the mother with her child. After initial training on each 
technique, bi-weekly observation and feedback sessions were conducted • 
in the home. During these^sessions, mothers and children play with 
toys during a 15-minute au|diotaped session. At the beginning of each 
session, descriptive and graphic feedback were given on use of the 
techniques during the previous session. After 10 minutes of play, 
mothers were given specific feedback on their application of the proce- 
dures. An addition 15 minutes of audiotaped practice followed the 
break for feedback. 

The techniques were trained one-at-a-time . After a new technique 
was trained, mothers were asked to practice using it, and to continue 
using the previously trained techniques. 

In addition to using the procedures during the training sessions, 
mothers were asked to apply the techniques incidentally throughout the 
day whenever opportunities arose to work on their child's language. 
Generalization measures v/ere obtained in three settings: (1) during 
audiotaped Practice Sessions that took place when the observer was not 
present; (2) wherv-'the mother was engaged in a domestic chore; and (3) 
v/hen the television was on. Maintenance checks were = conducted 
monthly for three months following completion of the Incidental 
Teaching condition. 



In the trainiiig, 'jeneral izati;?ri , and n^aiiitenance sessions, data 
were conected on rnotiiL.:^s' rate and percentage of correct use of the 
techniques. Data on changes in child rosponsi veness , intell iqibil i ty, 
rate and linguiL^tic complexity were also collected. 

Resul ts . Results of the study indicated that. mothers did not 
use the teaching procedures during buseline. Rate and percentage o' 
correct use of each procedure increased immediately following trainin_. 
on that procedure. Furthermore, mothers used several different 
teaching procedures within a S''.iqle session. All mothers generalized, 
to varying degrees, their train^nq to all (-general i zation settings. 

Results also showed that children's respc -.s and rate of talking 

increased when mother-teaching was introoi. .lata on the complexity 

of child resoonses have not been fuVly anal^^u^a, but it appears that 
changes in complexity also occur'-^^d foT^owing training. Anecdotal 
reports by parents and by teachers in the children's preschool class- 
room suggested that attenti veness . responsiveness, and imitative skills 
improved fo' owing mothers' use of these techniques. Trained m.others 
consistently have reported th^n'r sa"/i sfaction with the training program. 

Initio l conclus ions. Several issues which v;ere identified as 
requiring atciitional research'' Deca'.-e apparent during this study. One 
of those issues concernec the dirf icuU.y^of applying the techniques 
with children exhibiting bet:avior problems. It became clear during the 
study t\v\t the behavicr problems ut some children interfered with 
their mother'^ -h-lity to effectively apply the procedures. Further 
applications .>r incidental language traininy by parents mi.qht be 
enhanced by developing an assessjment procedure for determining when 
behavior management t^ainm-j isjin order prior to training in language 
intervention. / 

A second issue for future/ research concerns identifying training 
procedures tt' t preserve the t/ruly incidental quality which is intended 
in these procedures. In the ^tudy I've described, mothers practiced 
using the techniques in 15-miiiute play interactions with their 
children. Perhaps because rrite of use of the procedures was included 
in thvir feedback, the mothers seemed to try to use each procedure 
as often as possible during /the 15-minute interactions. It was not 
uncommon for mothers to use [the procedures two times a minute. lhis 
frequent use of the procedures resulted in a more-than-desi rabl e 
didadtic-1 ike quality to thfe interactions. In order to optimize a 
more incidental "^appl icationi of the procedures, future training might 
focus on parents' application of the procedures in several natural 
settings' and situations. Incidental application might also be enhanced 
if feedback focused on utilization of naturally occurring opportunities, 
with less emphasis on rate of use. 

There is empirical evidence to suggest that like trjined teachers, 
parents can also be trained to use incidental teaching strategies 
with young, language-delayed children. There are also data indicating 
that mothers are likely to generalize their use of the techniques to 
other, non-training situations. Data reflecting mothers' maintenance 
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of the trained techniques are still being collected. It has also be.n 
round that as a result of parents' use of incidental teaching strate.jies 
improvements may be seen in the rate, complexity, intell igibil ity and 
runctional use of language by the children. 



III. GENERAL DISCUSSION 

A brief summary of the basic results of this research program 
IS presented below. 

1. Comprehensive language training efforts with language-delayed 
preschool children do result in significant generalization. ~But this 
generalization is limited to those structures trained that are within 
the child's general developmental level. 

2. Language trainers should strive for a communicative match 
between the curriculum and the general developmental level of the 
child in order to facilitate maximal generalization. 

3. Many language-delayed children come out of intensive structured 
individualized preschool intervention programs, go into public school 
classrooms, and then tend to plateau in terms of their rates of 
academic and language developr:ent . 

4. Identified poor communicators in kindergarten classrooms tend 
to differ from good communicators primarily in terms of the structural 
characteristics of their speech and their conceptual knowledge and 
abilities compared to their peers. 

5. Milieu teaching strategies (i.e,- time delay, modeling, 
mand-model procedure, incidental langur. teaching) are the most 
effective alternative or augmentative luMjuage training procedures 
that we studied. We recommend that they be routinely incorporated 
into both preschool and elementary language intervention. Their 
effects are generalized and they can be effectively utilized by parents 
and teachers. 

These results represent a mix of encouraging and discouraging 
findings. We have found that children in a 'state of the art' preschool 
language training program do not make entirely successful transitions 
to public school classrooms and we believe the problem is that they 
have failed to acquire a generalized "learning to learn" strategy. 
Faced with new content in new circumstances, brought on by their 
transition to regular public school classrooms, they do not do very 
well, despite their success in our program. This suggests that it 
is not the generalization of the specific content, but the learning 
strategies acquired by the children that is most important in the 
long run. This conclusion is further supported by our findings on 
the differences between good and poor communicators in elementary 
school and on the developmental constraints on language generalization. 
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Uhat is the common denonii na t;or here and what are the iriipl ications 
for early language remediation and for promoting successful transition 
of these children into the public schools? To put it in the most 
positive terms possible, this data suggests that we have not yet^ 
addressed the most basic issue of remediat ion— how to teach a child a 
generalized learning strategy that can be utilized to acquire new 
information and skills in new situations and settinCi across time. 
Children did well in the preschool because it was a remedial, highly 
supportive, carefully individualized environmen-. This cannot be 
typically said of public school classrooms. Short of a social 
revolution in the American education system, about the only thing ^ 
WG Gin ao is devise preschool inLurvention programs that succeed in 
teaching the child a strategy for learning— not just a smorgasbord of 
specific skills which we believe the child will need in other settings. 

We believe the optimal preschool language training program tobe 
a combination of structured and milieu training. Structured training 
in combination with generalization programming will lead to generaliza- 
tion. But milieu training will further enhance this generalization, 
facilitate language acquisition in general, increase rate and responsive- 
ness, and perhaps most important, teach the child the mediating functions 
of language. This approach will facilitate a communicative and social 
match between the child and anyone using it, and can be used 24 hours 
per day. Finally, this approach utilizes the child's attention and 
is usually child directed, thus giving it maximal functionality. In 
5ur, further research on the uses and aopl ications of milieu teaching 
strategies, is our number one recommendation. 

We have a number of other areas of recommendations as a resu 1 l 
of our research on language generalization over the past 6 years and 
these are presented and discussed in t!:2 remainder of this section. 

A_ j^w Generation of Pr ograms? 

The field o" language remediation may be ready to pass from its 
initial "founding" phase to a new phase. During the initial phase, 
a number of comprehensive training programs were developed. These 
programs have not been based directly on a systematic, scientific 
effort although they have been strongly influenced by research in 
nsyrhol inguistics, psychology, behavior analysis, and the speech and 
hf-aring sciences. The programs were developed to meet the educational 
requirements of the many retarded and language-delayed individuals 
who have recently entered the mainstream of educational systems. I he 
rapid development of treatment programs nas in many ways met this 
initial need. There are now over 170 programs (Fristoe, 1976) which 
claim to teach language. The extent to which each program meets its 
goals is a timely question. There is a second question whicn follows 
logically from the first: How can language training programs, be made 
to work better? Answers to these questions should provide the basis 
for the development of a new generation of language training programs. 

The new generation language training programs should meet three 
criteria. First, consent and procedures should be based on research 
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in lanquaije iJevolopfiieii t and reiiiodi n nen . jecond, program formats; 
should reflect recent developments in the cechnoloqy of generalization. 
Finally, prorir:-ii:i'j should be subjected to a generalization analy^Js 
conducted longitudinally in the natural environment to determine their 
overall effectiveness. The third criteria requires considerable time 
and resources. Yet, if such analyses are net carried out, there will 
be no basis for insuring that wr^ograins are effective in meeting their 
intervention goal s . 

Second generation programs vn'll not represent completely novel 
curricula. Rather, they will consist of the pieces of current programs 
which have been shown to work (via longitudinal generalization analysis), 
combined with new content and "techniques based on recent research. 
As such, they will represent the logical evolution of treatment rather 
than a revolution. The three criteria for these programs warrant 
further elaboration. 

1- Incorporate devel opmental re search . Knowledge of how normal 
children acquire and learn language has grown enormously in the 
last 20 years. The usefulness of this work from a therapeutic perspec- 
tive drppnds on the extent to which it can be related to language 
re' '-diation. 

Historically, m^ny interventionists have often chosen to ignore 
dev-' 'Opmental data because it infrequently offers a sufficient task 
analyses for teaching new skills. In some instances, such as the 
, wprely retai ded child in an institutional setting, th- selection of 
a .'^uni.tjV'^l opmental ly based curriculum may be warranted because the 
communication skills to be trained will be few and quite specific to 
the student's restricted environment. Generally, developmental data 
describing what the child normally learns in natural environments 
c-n be very useful to tf.e language programmer. If viewed from a 
behavioral ^c'^S[)ec'' rjh ^ developmental data represent those behaviors 
(commun^'cation fu .aian, semantic relationships, and grammatical forms) 
whioi. are most equeiitly reo ired and reinforced by the natural 
'ji .ivonment. be».^C'.inc tra^^ning exainples and structuring programs 
i-'hich coincide witt th? environmental language demands should maximize 
general ^zation oportunities . 

Although few osycrol ingu i^as have examined language with the 
intention of providing a basis ^cr L''^ec^^ent, their research has 
provided important perspectives on both the function and structure of 
language. To this point, the impact of dev^^lopmental research has been 
fel" mo^.t "Strongly in the content of training programs. During the 
1960-;, psycnol inguists emphasized syntactic development (Chomsky, 1959; 
McNe'^;i, 1966). Many training programs developed during and after this 
time have focused on syntax training. In the 1970s, the psycholinguists 
shifted emphasis to semantics (e.g.. Brown, 1^73; Schlesinger, 1971), 
and subsequent training programs eiiiphasized semantic training (Miller 
& Yoder, 1974; Stremel'S Waryas, 1974). Since the early 1970s, the 
emphasis has moved toward pragmatics or function of language (e.g., 
Bruner, 1975; Dore, 1975; Moerk, 1975). As yet, few language 
training programs expressly represent this emphasis, although some 
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new prorjraii. Iruerestiivily , Lhe current praqinatical ly oriented 

psycho! inqu , finalysis of lanquage acquisition shares many assuii.p- 
tions with ji Mifier's (1957) models of adult lanquaqe (Hart, in press; 
Moerk, 1977). As a qeneral rule, for a response to generalize, it 
must be functional In nontraining settings. Thus, research describ- 
ing the typical coiniiiunicati ve intents or ways normal children use 
language snay suggest examples and teaching formats that will he 
useful in training functional language skills with delayed ■.■ iHents. 

Currently, descriptions of how mothers actually teach language 
CO their children (e.g., Folger S Chapman, 1978; Moerk, 1976) are 
appearing. Studies describing the strategies, tactics, and formats 
mothers naturally use to sequence and integrate language in daily 
interaction may provide models for effective training techniques. 
Possibly, optimally successful training programs will require the 
primary caretaker to be the intervention agent. In such a forinat 
the therapist would treat the caretaker-child dyad, not the child 
alone. Such an approach might readily improve the general izaiion 
potential of training because it would occur in settings where language 
normally will be used and at least one person (the caretaker- 
interventionist) will be readily available to shape, prompt, and 
reinforce the child's language. MacDonald, Blott, Gordon, Spiegel, 
and Hartnian, M. (1974) have provided one model of such an approach 
for younq Down's syndrome children and their parents. 

A survey of currently available language training programs 
suggests that only a few have incorporated recent behavioral or 
psychol inguist-ic research. The majority of the programs reflect one 
or another dimension of language (syntax, semantics, pragmatics) 
at the expense of other aspects. Optimally, all three systems must 
be accounted for because functional communication requires the child 
to use all three. The "form/f unr "ion" model we developed under 
Objective 1 is meant to do this. 

A conceptualization of the v-elative roles of syntax, semantics, 
and pragmatics in language acquisition is important to the selection 
of convent for new remediation programs. As knowledge of these 
aspect, of lan'juage ano ^.heir integration changes, ei-^hasis in 
training should follow. Likewis'^, infor-jation abo'j^ how mothers _ 
teach language to their children may be useful in devising naturalistic 
formats for training. Finally, a knowledge- of how otner conceptual 
skills (e.g., short and long-term memory, problem solving, etc.) 
interface with language could indicate other behavioral repertoires 
which should be trained concurrently for language training to 
achieve maximal effectiveness. In short, languao^ 'Taming programs 
should evolve and change as knowledge of language itself evolves and 
changes. By this standard, most of the currently available programs 
are out-of-date and need revision and modification. 

2. In corporat e a. ge neral i z^tj^n t echnol ogy . The second 
criterion"for new training programs is chat they incorporate techniques 
and procedures to promote generalization of training to the_natural 
environment. Generalization is receiving increasing attention in 
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all type::, of tred hiu^nt tjndtM vor-, and irt.Mjiiefii.ly is recoiin i zed .1^; ttio 
inoct relevant: inedsiire of treo liiiient effectiveness. 

Much [jro()r-p*Oi^ lids been made toward a technology of generalization. 
Many coiiiponcMi of thiE. technology have bfu^.i specified (e.g., Stokei-. 

Baer, 1977). In language training the systematic use of techniques 
•>uch as multiple exemplars (e.g., Guess & Baer, 1973), common stimuli 
(e.g., Rincover it Koegel , 1975), indiscriminable contingencies (e.g., 
Schwartz Hawkins, 1970), and "loose training" (e.g., Schroeder & 
Baer, 1972) holds much promise for facilitating better generalization, 
especially when combined with a highly relevant and functional 
content. Nevertheless, a gv^eat deal of research remains to be done 
on the application and effectiveness 0^' these technigues. 

Generalization is mentioned in some languageXraining programs, 
but procedures for facilitating it are seldom spr-cified. The natural- 
istic, conversational formats used in some training programs (Bricker 
Bricker, 1970; MacDonald & Blott, 1974) may proffiote generalization but 
no current curriculum systematically facil itateigeneral ization. The 
development and Incorporation of general ization ,\assessment , and 
facilitation pr^Mo^dures within the training currihulum is the second 
recommended criterion. / 

^- Ass ess gent:)-al iz^^-^'ori . The overriding issue of generalization 
is the guiding prirc^Dd"; all three proposed criteria. The third 
criterion reguiies -is ' or naturalistic assessments to mea^u>^e the 
effectiveness of uHj M'.tc> vention program. Ideally, the program 
being evaluated wi ' ^ -^t - uU of changes made on the basis of 

the preceding re. ijations. 

The "Third criterion insures t^ t information about ef fecti v^^ness 
/lew .^onrams is available to potential users. Unfortunately, the 
MCt' ior. 0^ these criteria may be expensive in terms of both time 
effort. Il necessitates the measurement of the different possible 
e .ects of training over extended periods of time in several settings. 
Only to th jxtent that generalization is shown by this approach can 
a program be considered successful. Ongoing measurement of generaliza- 
tion can also indicate specific aspects of a program which do not work. 
This, in turn, will allow further modification o" the program. For 
example *n conducting a longitudinal generalization analysis using 
the G.i<.^s -, :ailor, and Baer (1978) training program, it has been 
found -^t several steps in the program do not work very effectivt'l , 
(i.e., generalize) with severely retarded children. Based on this 
informatit^n , program revisions are now in progress. If *:his logic 
were followed in the development of all programs, eventually alf 
^; ograms would work as effectively as possible. The process is time 
consuming, and not particularly compatible with the rapid development 
of new programs. However, there is no advantage to be gained from 
new programs unless they can be proven to work better than existing 
ones . 

The three proposed criteria can and should be applied to existing 
program.. Many aspects of these programs may work. If so, there is 
no need to develop entirely new programs. A more reasonable and 
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econoiiiic approach would bo t.u roviso curroiU. programs on tho basis 
of the proi)o-.od criteria and |.)roniote the wido di ssoiuina Lion of these 
proMraiiiS, ' m h a jirocoss will take several years. In the meantime, 
there aru ,\ number of tilings which individual therapists and 
practitioners can do with existing prog)\ams to make them more effec- 
tive. I'Uicli can be done now by carefully selecting frofu existing 
proqrams tlie curricula with the most functional characteristics, 
furtfier modifyinn these programs to encourage cjeneral ization, and 
ttien measuring -for generalization. 

Us i \v] Ava i 1 a bl e Programs 

A large number of progi^ams currently exist, and some of ttiese 
pr;voM!!is are better than others, particularly for certain types of 
populations. For e, niple, tne Guess, Sailor and Baer ' 1978) 1 anquage 
training program is a function-based curriculum well suited for 
institutionalized severely and [)rofoundly retarded children. ' is 
extremely well specified within its limited purpose. It does :)t_ 
purport to teach a complete set of normal language skills. Therefore, 
it would not be wise to use this program with minimally or modera\^ly 
retarded home-living children. Other programs ai ^ better suiucd to 
vjach more broadly based skills in a less reduncint fashion. In 
qenenl, when selecting a training program the .ollowmg guidelv- s 
should be followed. 

1. Make sure the content to be trained is functional. Training 
word and sentence forms which the chi'd will never have reason to 
display in th ^ natural envv onment is c poor generalization tactic. 
Emohasize mi ]e sentence forms which are likely to elicit positive 
conseguenc'. for the speaker in terms of actions performed, needs met, 
or social conversations conducted. 

2. Make sure the content is trained using a multiple exeiiiplar 
format of the general form, at '!east. For e/ample, if the goal is 

to train a child to make requests, several forms for doing this might 
be taug'm , That is, tra'.n multiple exemplars of multiple exemplars. 
For instance, one might tram "I want (hat, cup, ball, toy, coke)" end 
"Pleas- give me (hat, ban cup, toy, etc.)". Both forms have the 
same function but have different forms. Incorporate previously traine 
simpler forms into more complex forms. This ensures repeated exposure 
to the simple form and allows the student co learn new forms via 
chaining or shaping. 

3. Make sure solid behavioral principals are used tnroughout 
training. Almost all program-, use some standard behavioral cc 
like shaping, modeling, and differential reinforcement. F!owl .er , 
frequently these procedures are poorly specified. Some programs 
ignore the critical necessity of fading out reinforcement to a 
schedule more like what one would find in the. natural environment. 
Instead, they specify that the child should receive .reinforcement 
after every correct response until the response is acquired. Then, 
another response is immediately trained without fading reir ^orcement 
for the first response. Such an approach is likely to result in 
response extinction (Ferster & Skinner, 1957). 
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Ttio topo(jra|)hy of re inforc{.'!mMit must bo Functional. Food and 
social praise arc often potent reinfoix:ers in training, particularly 
with sevorely roLardod children. Howevei', these are not general ly 
the reinforcers available foi^ lanyuacje in the natural envi ron'i;-fi L . 
Attention, continued conversation, and fulfillment of requesL.. are 
more typical consequences. "Natural" i^einforcers may have to 
introduced gradually in order to maintain responding, but unlv:.. the 
student's performance can be iiiaipt Mried with such reinforcers, 
generalization is unlilely. 

4. Make sure that f .her generalization facilitating formats 
and pr')ceduros are specified in the program. For example, determine 
if training can sometimes be conducted in a natural environment (e.g., 
the classroom, t^^e f.oiiie, etc.). Look for the systematic use of two 
trainers to efirourano leneral ization across persons. Training in the 
presence of peers may be useful for the same reason. Additionally, 
check to see if the program specified procedures for selecting stimuli 
used in the training setting based on their presence in the generaliza- 
tion setting. 

M o difying Fx i i i ng Programs 

Vet^y few current language training programs contain information 
meeting these guidelines. Individual trainers will need to modify 
progran^s to increase effectiveness. To do this, a trainer must have 
a general knowledge of the current technology of generalization. A 
careful reading of the Stokes and Baer (1977) review of generalization 
techniques is recommended. 

Within the guidelines outlined previously, several specific 
modifications are suggested: using of multiple exemplars, multiple 
trainers, multiple training settings, and incorporating variable 
schedules of functional reinforcement. Other suggestions to enh.-^i^o 
generalization follow. 

1. Children should be taught to initiate newly trained language. 
The training format of many programs only teach the child to respond 
to questions and models from the trainer. Verbal initiations will 
help the child recruit reinforcers and language learning opportunities 
in ihe natural environment. Excellent suggestions for training children 
to ■ 't. iate speech are discussed by Hubbel (1977). 

Along the same line, students should be taught how to 
par': pate in conversation, to take turns speaking, and to follow 
the conversation topic. Current events discussion groups can be 
useful in facilitating this skill (e.g., Keilitz^ Tucker, & Horner, 
1973). Unfortunately, little systematic research has been conducted 
on efficient ways to train this skill. Initial training in nonverbal 
interaction and turn taking may be quite useful as well (Bruner, 1975). 

3. Increase the overall rate of the child's speech. Rate of 
speech is an often overlooked dimension of language delay. Most 
language deficient children not only speak poorly, but also infrequently. 
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Witli .\n a|ipfi)|)f iiitL> :iiiicli,T,it.ely I'^iti.' oT spfMMJi, a cliild cui LOiiLail. 

ttiij iKiLural ro infoft.or'., for Idiiqiiach? as wo M -v, ijrovido incroa'ajd 
(>(i|uir1,uni tir.''; i'lr trairiL'r.> or caror.al of:; to expand and di^scn-Li'ly 
correct t.ht.' idi i I d ' laiiguacie by providincj aUenuUive model'.:.. I tie u-a." 
of inc idt-TiLal tuachi ny techni.pa", liave been shown fjuit:o effect, ivo in 
buildini] t-ate (Mart:, in |)rojv.; llatM; S Risley, 1975). 

■1. The inclusion of [jarents and caregivers as trainer:, and 
facilitators of languaqe is complementary to direct traininy. Their 
participation in the remediation efforts can facilitate generalization 
and oncnuracie incidental language tutoring. Most language prompting 
.1,1(1 tr lining |)roc(^hires can be easily adapted fur parental use. The 
tiMinor should see that these are done systematically, juch an approach 
can effectively make a child's entire environment a language training 
setting (which' is how the environment works for normal children). 
The milieu traininy approach offers the ideal vehicle accomplish 
Lli is. 

'Tea s u r jijig^ ii?lLflCclIiyi-J_.'i'T 

Measuring generalization from language training to the clinical 
settings does not have to be prohibitively expensive or unwieldy. 
It should be a standard part of the overall treatment program. The 
demonstration that the student has generalized the target responses 
should be the ultimate criterion for treatment effectiveness, several 
generalization assessment strategies can be used by the clinician. 

Structured probes should be included as a first step in assessing 
generalization. If students fail to produce a correct response during 
the probe it is unlikely they will produce th^se responses in natural 
environments when the stimuli and conseguent events are even less 
similar to training conditions. Probes can serve as a useful screening 
device to indicate which forms require further training for generaliza- 
tion and which forms might be expected to be used spontac-ously by 
the child outside of training. Finally, probes are economic and easy 
to incorporate directly into the sequence of training. 

Uhile probes .-Duld be a standard part of any training program, 
they are not a completely reliable indicator of the student's use of 
the training items in natural environment. Correct responses under 
probe conditions do not assure students will actually produce these 
responses in conversational contexts (Warren & Rogers-Warren, 19auj. 
The cost in both time and effort of generalization measurements in 
the natural environment does not have to be prohibitive for clinical 
purposes. A number of approaches may be used including those outlined 
bel ow. 

1 Teachers and caretakers be provided with a list of trained 
forms that have generalized durinn structured probes. They may then 
record students' use of these forms during the periods they interact 
with them. This infonnal technique may hav - 'he ;^dded benefit ot 
bringing the caretaker or teacher's atten . child s 

progress. 
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"ic \u\yi,n\t ())' t:,(jaclier tiri()lit; .i1<;o prv-.i^nt: [irdlu; i tciir, [ roin .1 
lisi: nf IrMidtMl tonus. These inrornuil |)rol>ov> could bo carriod out 
if) t.ho i;()fil:f-<L of t:lio student's ofKioifK) .ic t i v i t i{?s . Foi^ example, if 
till.' |)lnMM' "vAMiL lull" wer^e aiiiofK) Uie t:r.Minfi() a |)a)'en(. playifK] 

l)ciM wil:h t.he tJiild might hold tlie ball up and say to the cliild, 
"Wliat wafit?". This teohnique nt.i, only provides a iiieasuro of ({enerali^. 
tion, but may be a niuans of fac i I i Latin() it. 

3. It is also recoininended that therapists occasionany make 
veri^a till! records of studonts' speech in nontraininq settinqs. 
Observations should be made at times when speech is a high probability 
event for the student, sui h as freeplay time in the classroom. 
Verbatim observations should be kept as a permanent record of the 
child's actual language use. Weekly 15-ininute observations would 
allow therapists to estimate generalized effects of training on the 
student's linguistic structure and pragmatic functioning bvComparinq 
these samples with the child's training records and past natural 
samples. Observation times and settings should be varied and the 
frequency of observations maintained to increase the probability of 
obtaining reliable, representative samples of the student's language 
production. 

Naturalistic observations may provide therapists with additional 
information on the dimensions of the student's delay, which can be 
used to niodify training in ways appropriate to a child's specific 
disabilities. Standardized tests, the basis for placement or many 
children in language remediation programs, are generally biased to 
measure production instead of comprehension. Naturalistic observations 
may indicate that a student seldom displays language, even thougfi new 
lorms are learned quite easily in training. This is an indication the 
child needs training in the pragmatic and social aspects of language, 
as well as the conceptual aspects. 

The naturalistic assessment of generalization by therapists goes 
hand in hand with other strategies suggested ^^bove. In the absence 
of proven training curricula, this strategy can insure a degree of 
effectiveness in program modifications made by the trainers themselves. 

Fut ure Resear ch Dir ections 

VJe have much basic and applied research left to do. Our tech- 
nology of generalization has perhaps only addressed the first level 
of the generalization problem. The study of generalization following 
tiansition may be an extreme test, but it's also an ultimately valid 
test of comprehensive remediation efforts. 

A few suggestions, then, for future research: 

1) Research on the effects of incidental teaching strategies 
on the acquisition of generalized learnin(} strategies. 

2) The experimental analysis of procedures to train generalized 
attention and discrimination skills— -a relevant area where 
we still need to do much work. 
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8) Research on ways to efficiently and effectively train parents 

and teachers to t)e milieu lantjuage trainet^s. 

i^oncl us;^i on 

The study of the effects of transitions on children's general iza- 
ti...i, skill acquisition, and maintenance takes us far beyond the 
laboratory and even the initial learning situation. It forces us to 
address head on both the strengths and limitations of our behav ioral 
science to date, and may eventually cause us to view the issue of 
oeneral ization from a much broader perspective than vie currently do. 
in the meantime, educators and clinicians are urged to adopt and modify 
or^oqy^ams, with the intent of enhancing generalization of trained skills 
!:Mid to insure the effectiveness of these modi fi Ccst ions through 
systematic generalization assessments. Even more importantly, they 
are urged to begin utilizing milieu training approaches as mucli as 
possible. Fiiture major improvements in the field of language 
remediation o/ depend on the pursuit of these reconnnendat ions . 



IV. EMIMATION SUMMARY 

The following is a summary of dissemination el forts to date. 
^Additional dissemination efforts of the research findings will 
proba[)ly continue tor several years through the joui'oal publ ication 
process. This summary has been divided into three sections: 1) 
Articles published or in press; 2) Articles in preparation; 3) 
Papers presented at conferences. 
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Rogers-Warren, A., & Warren, S. F. Mands for verbalization: Facilita- 
ting the display of newly taught language. Behavior Modification, 
1980, 4, 361-382. 

Warren, S. F., & Rogers-Warren , .A. Current perspectives in language 
remediation: A special monograph. Ed^jcation and Tre^atment^of 
Children, 1980, 3. 133-153. 
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K e r n a n , M . Began, & R . E d g e r t o n (Eds.,', S e_t_t in cj s_ and t] ) ( ^ I \e li a_y J o r 
t'^ILd__J tiKiv__of retarded persjoj^s. Baltimore: University Park 
Press', 1982.-"^ 

Rogers-Warren, A., Warren, S. F., & Baer, D, M. Interactional bases of 
language learning. In K. Kernan, M. Begab, & R. Edgerton (Eds.), 
SAt_tJlP9_^ _^d_t hj:'_ beha yjo r^ and study of retarded persons . 
Baltimore: Univer'sity of Park Press, 1982. 

Warren, S. F., & Rogers-Warren, A. Language acquisition patterns in 
normal and handicanpod children. Iopi^s_ij]_E a rjy ChjJ.'hood 
Special Educ a tion, 1982, 2, 70-80. " 

Rogers-Warren, A., & Warren, S. F. Pragmatics and generalization. 

In R. L, Schiefel busch (Ed.), Conimun i ca tj^ve_ competence . Baltimore 
University Park Press, in press. 

Warren, S. F., & Rogers-Warren, A. (Eds,) TjjachjjT^g_j^^^ 
Baltimore: University Park Press, in py'ess. 

Warren, S. F. Evaluating the effects of training: Methodol og-ical 
issues and cl inical strategies. In S. F. Warren & A. Rogers- 
Warren (Eds.), Teaching fu nctional lang uage. Baltimore: 
University Park Press, in press. 

Roqers-Warren, A., & Warren, S. F. Facilitating early language and 
ocial development: Parents as teachers. In E. M. Goetz & 

\. E. Alien (Eds.), Ea^rly childhood education: Special , 

environm ental and legal considera tions. Rockville, MD: 
Aspeh Systems Corporation, in press. 
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Denver, November 1982. 
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Texas, March 1982. 
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paper presented at the International Symposium on Autism, 
Woodbury, New York, February 1982. 
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Appendix 1 

Cumulative Graphs of Individual Subject 
Longitudinal Generalization Data 



All the generalization data represents the subjects' actual use of 
the trained structure under natural conditions in their preschool 
classroom. A summary of this analysis was also presented in the 
previous report. In this appendix we wish to present the 
individual subject graphs for 10 children. This includes data for 
34 forms trained over time across these subjects. This data 
is presented in multiple baseline design fashion in the following 
figures. In these figures the generalized effects of training 
each form can be seen for each subject. All data is organized into 
sequential observation blocks. Each observation block represents 
four consecutive observations. 
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Appendix 2 
Observation Codes 



This appendix consists of two observation codes used in this research 
program. The two codes are: (1) Instructions for Live Verbatim 
Recording, including reliability instruction; and (2) the Child 
Verbalization Context Code. Each code is self explanatory and 
contains a sample data sheet. 



Instructions for Live VerbaLiin Rocorcliny 



Recorcl every thiruj tlio child says exactly as it is said. Do not correct it. 

Exaiiiplos: subject-verb disagreement: 'the cats is here' 
inconiiJlete sentences: 'sit cliair' 

iJuiiibei^ tlic minutes (1-15) 

Using a stopv/atch (or the classroom clock if a stopwatch is not available), 
record tlie child's utterances in correspondence to the intervals noted 
above (minutes). 

An utterance is recorded in the interval in which it began . If an 
utte)\incG begins in the last second of the first interval, the entire 
utterance would be recorded in the first interval even though it may 
have overlapped both the first and second interval. 

Record child utterances for 15 minutes. If the child loaves the room 
(e.g., goes to the bathroom), stop recording. Resume recording when 
the child returns. Do this only wlien the child leaves the classroom 
area. Children will frequently move within the classroom, continue 
recording as they move above. 

If you cannot understand a word the child says, mark the word as 
unintelligible (-^^^) . Listen for inflection and try to determine 
how many words a child said even if you cannot tell what they were. 

Examples: he xxx me/ (one word unintelligible) 

he is xxx xxx xxx chair/ (three words unintelligible) 

NOTE: Because sentences with unintelligible words usually cannot be 
included for data analysis, please mal:e every effort to 
transcribe the word. 



7. If you arc not sure wiiat the v/orcl was, but can make a reasofiable guess, 
mark the word as unintell igible (-i.ci.,) then indicate in parentheses 
the probable meaning. 

Example: he xxx (hit) me/ 

8. Cajoitalize only proper names and tlie personal pronoun 'I'. 

9. Do not include commas, question marks, or any ' ■:licr punctuation except 
apostrophes to indicate contractions and possession. 

10. Segment utterances by function (see Context Code). 

11. Punctuate utterances with a rising intonational contour (question 
intonation) witli double slashes (//). 

Examples: is he a daddy// 
this one// 

12. Indicate all target-child utterances directed to peers or teacliers by 
marking (P) or (T) after the utterance. 

Example: Peer to subject - Hi Susie/ 
Subject to peer - hi (P)/ 
Subject to teacher - there Susie (T)/ 

13. When transcribing from the tape recording, eliminate all repetitions 

of a word or sequence of words which occur together within a particular 
utterance ( di sf 1 uenci es ) . 

Examples: (a) Child utters - my my ball/ 
Transcription - my ball/ 

(b) Child utters - that dog that dog is green/ 
Transcription - that dog is green/ 

14. When the 15 minutes of transcription is completed, check it over. Make 
sure each word is easily readable by the typist. Check the segmentation 
(making sure that slashes have been nsed rather than conventional punctua 
tion). Check to make sure the minutes' marked correspond to the recorded 
utterances. 
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Reliability for V'Jt'Ijatliii 



Score the tv;o records by coniparinig them, morpheme l)y inor^'' 



jjliei ,0 



(This comparison mean:, cbi.'ckiiuj each woni, and in v/ords with 
prefixes, suffixes, verb tense markers, plurality iaarl;et-s, etc., 
also coiiipanncj tlie markers.) 



Exai;,ples: 1 

+ + + 



2 



I ran house i ran house 

+ + - 
he goO 

+ + + - 

I need crayon^ i need crayon 

SUe\>) here she here 

flark each agreement as plus ( + ), each disagrcorent as minus ( - 

Compare each record's segmentation of utterances, marln'nn each dis- 
agree;r,ent. 

Example: l 2 

Right/ I'm going now Right^I'm going now 

If one observer has marked a v/ord as unintcll ioible (^^/^') and the 
secor.d observer has transcribed the word, do not use tiiis word in 
dc to nil i n i ng re 1 i ab i 1 i ty . 

Exai^:ple: 1 2 

+ - + 

I /-//^ him I like him 

If botli observers have scored the v/ord as unintelligible, do not 
count the agreement in calculating reliability. 

Reliability for transcription of words is detcnnincd by the formula 



, Number of agreements 

iiUHiber of agi-oements plus nuiiiuer of disagix'cmentT 
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ProparilK; Verbatim Data fur CoiiipulLj' Cntry 



Tho Child Verbal i .'a tinn 

A. Tyrm o\)o child uLLcraiu:(> \M:r liiu.^ cxacbly as you lioar iL oii the (ape usiiuj 
"xxx" for uiriiiljill ioiblo words. 

B. Use co;i::::'as to separate vocativos and interactions: 

1. Vocatives arc narjcs or ono-v;ord at tcntiofual s such as "lool;," "v.-atc!)" 

2. Intoracl/ionals are words such as "ploaso," "yes," "no" when tacked 
onto anotiier sentence at the beginnirrj or end 

"Yes, I want to no." 
"Can I do it, ploaso?" 
"rJo, that's mine." 

C. Exclude utterances that consist entirely of unintell icjible words, 
recitations, counting, singing, except nui::bers or letters given as one- 
word reSDOnsos. 



D. Separate fno)^;:hc:;:es by at least one blank and adjust the root 
niatchcs co;r.::lon snellino: 



0)^'J so it 



go ing 
run ing 
bake d 



— verb endings 



I 'm 
do n ' t 
you ' re 



she 'is 
it 'is 
lot 'us 



contractions 



contractions 



Ann 's 
Steve 's 



boat s 
match OS 



possessive: 
plural s 



Don't include oli, ugli, yoow, ow, or repetitions of noise words. However, when 
a noise word is used as a noun do include it: 



tf)is is a choo-choo 



F. Cliaivjo yoali to "yos" 

uh-huh to "yes" 
uli-iih to "no" 
no[.)C to "fio" 

G. tlypticnato all -right: and all~cjonc3. 

II. Conibino two coi^^ccutivo noLii^s into one v;ord. 

End I'arLors 

A. A single slasii ends the child verbal izatiofi for all utterances v;itli 
fal 1 ing intonation. 

B. Two slashes are used to indicate the end of uttci^ances with risinc; 
intonation : 

that is mine/ 
Is it mine// 

Functions 

A. List all the checked functions after tlie slash(es) using appropriate 
abbreviations separated by blanl'.s. 



?il P 

T// T 

Correct V- C+/C- 

Approp +/- A+/A- 

nand M 

Verbal Stim Vs 

Declar D 

Quest Q 

Answer A 

Request/Com PX 

Response to Hand Rfl 

Response to Correct R-t- 



ERIC 



Vocati vo 
i tat ion 
Ro|'cL i t, ion 
VcmHxiI Play 
Sol r Rog 
Interactional 
Protest 
Aff irriiative 
UncoJabl e 



CHILD VERBALIZATION CONTEXT COPE^ 



Language Project Preschool 
Bureau of Child Research 
University of Kansas 

Suzanne Genclreau, Buchanan, 
Ann Rogers-Warren, and Steven F. Warr 
August 1978 



ERJC 



mparts of this code arc adapted from Moerk (1976). 
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25 

This code vyas devGlopcd to record the functions (communicative intents) 
of child verbalizations observed in various contexts while siiuul Laneously 
obtaining a vcrbaliiii record of those verbalizations. The code is used in 
conjunction with a tape-recording system (preferably a FM telemetry system). 
Einpliasis is placed on conversational verbalizations although two types of 
nonconversational utterances can be coded. The functions chosen cover a 
wide range of child verbalizations, especially tfiose which are stimulated 
by tlie verbalizations of others. However, it is not possible to code every 
verbal 1 zation- a child makes. In addition, support and stimulation that 
influence a subsequent child verbalization are recorded. 

The code was designed to be used in documenting situation-specific 
aspects of the functional communication by deviant and nondeviant populations 
The code can be used in compiling a functional profile of the communicative 
idiosyncrasies of an individual child. For best results, the observer 
should be as familiar as possible with the child being observed. 
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CONTEXT com: 

An utCeranco in inarkccl [H- correct] if the lexical usaj^^.e io correct. 

Exampl(-r> : a) 'Can I have that boat' [- correct] 

(object is a car) 

b) 'Johnny kicked me' [- correct] 

(Jolinny actually pushed the speaker) 

APPkOPRIATEIinSS 

An utterance :s marked [+ appropriate] if it sec: to indicate that 
the cliild beliaves i^ accord ('in tune') with the conimuncativc demands of the situat: 

Examples: a: onvcrsational partner (C,P.): 'Tell me what you did 
v; " morning' 

Child: 'I go 7-00' [+ appropriate] 

If tlie child does not respond to the content of a given mand, that 

utterance is coded [-appropriate] 

b) CP.: M^hat color is this car?' 
Child: 'I go zoo' [- appropriate] 

c) CP.: 'Can you say cash register?' 
Child: 'Cash register^ [+ appropriate] 

VKUnAL STTMIMJ 

A verbal stimulus is a verbalization by some other person which in some 
way provides the incentive for a consequent utterance by the child. 

a) Mand: A verbalij:ation which by its nature requ ires some verbal 

• 

response by the listener. (See Appropriateness ) 

b) Verbal Stimulus: Any verbalization other than a mand. 
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I^^'T i n i t ] on : The inlcnLlon or purpDi^o of tlie utternncQ (i.e., in 
veii).il i::i;i[; \A\al effect: tlic cliilJ v:ic;lies Lo produce on his envi rtiriment 
or ll:.;Lcner). 

B) Tv]\f ; of Funrt ionr. : 

1- necl :]r:i t Iveh; : (Aijcert ionr: , lal)elin[;, deijcript ioni-O 

The function of intent ±s the 5hnrin[; of inf oiTnatiun for its ovni 
snl've. Must not be an anr-v/er to a que:;tion. 

EMnni.le^ : 'This book is red' 
'It's raininr; out' 
'I'm building a bridge' 
'Nancy is not behaving' 
'We' re going to the zoo today' 
'Book' (child is pointing to bool;) 

2. Questions : (Interrogatives) 

An utterance is verbalised by the child with the intention of obtaining 
information from his listener. 

Examples: 'How does this work?* 

'What ' s wrong with Timmy?' 
'Why won't the door open?* 
M'/ho's turn is it? ' 
'\ihere is niy smock?' 
*Does this work?' 

NOTE: Tags are to be separated (segmented out) from the utterance 

to wliich they are attached and given the function of Question. 

Example : 'I put the block there, didn't I* 

A) = + Declarative B) Tag = -f Question 

3. An svo*rs : Verbalisations in which tlie child supplies information in 
response to another speaker's question or request. 



ERLC 



123 



r.'i[;t» Three 



28 



n cr.]nMr; (' (An l; v: c r ) 



'Can I havti tliat toy?' 'No, I want it.' 

'VJhat arc you c]oin[^?' "Playiip/ 
'Are you f iniiihcd? ' *Uol yet' 

PvC!qitr'st5T/Co:nmnnc]?; : Verbal i::a tion:; uttered Vv'ith the intention of 
getting; the listener to perform Goir.e action (i.e., tlie ui;e of tlie 
listener as an a^ent Ol tool in ac]")ievin;_; aon:e desired end), Thece 
can be stated eitlier directly or indirectly. 

Examp] en : 

a) Direct Ronuents /Commands : 
'Open the door' 
'Give me the ball' 

'More cookie' (wants another cookie) 



b) Ind j rect Rcqnents /Commands 
Child Ver])ali^ation 

1. It's hot in here 
(Declarative) 

2. ' Can you open the door? 

(Question) 

3. \Thy not open the door? 
(Question) 

4. Can I liave a cookie? 
(Question) 

5. I want tliat toy. 
(Declarative) 

6. I don't have a smock, 
(Declarative) 



Envi ronmc*nt 

Child wants listener to open 
the doo^* 

Child is not seeking information. 
Rather, vjants listeners to open 
the door. 

Cookies are up on a sliclf — child 
wants adult to give him one. 

Child wants a toy v>?]iic]i someone els{ 
has. Wanrs adult to get it for hin. 

Teaclier has given smocks to each 
child in a group, but left the 
speaker out. Child (speaker) says 
tliis as an effort to get the teacher 
to give him a smock. 



5, Protests ; Verbalization uttered witli tlic intention of resisting another 
person's action or denying anotlier person's assertion, question or 
command (request) . 
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Knv i re m M-nt Chi r> Vi'r h. il i '/.:\ t i(ni 

a) Ad\iU ir. trying', to pun thtt ^Vto ;;hou' 
cliild':: r.hoc on, 

b) Another child ir. pushini; hin. 'Don't do that' 

c) Adult cays 'Thi:; xd a picture 'No, it's a horse' 
of a doc- ' 

d) Adult says 'Go to your room' 'I don't want to' 
KOTI- : If 'iJo' occurs as an AMSv;er, it is not a Protest. 

6. Vocritivns : Verbalization uttered with the intention of calling;; 
"* the listener's attention to sometl ' in the environment. 

ExaiTtples : Look I 

Hey ycul 
Nancy I 
Look at mel 

7. Inter actionals : Verbalizations uttered with the sole intention of 
initiating (or participatinc^ in) some sort of social interaction with 
the listener. These utterances convey some type of en:otion, 

Examp] es : a) Grectin2.s: Hil How are you? 

b) Expressives: I'm sorry. Thank you. 

8. Affirnntives : Vcrbalir.atii ons uttered with the intenti/^n of lettin^^ 
tlie listener know that the speaker concurs v;ith someone else's 
declaration (statement) . 

Examples : 

Environment Child's Vcrbali::ati on 

a) Other speaker says 'It's 'It sure is.' 
raining out. ' 

b) Other child says VJe coing to the 'Yes, today.' 
zoo today.' 

9. Verbal Play : This function is scored if the child is uttering a 
sentence which seems to serve no apparent communicative purpose. 
Tlic cont out of Verbal Play must not be relevant to the task at hand. 
(NOTE : Not to be confused with Self-Regulatory uttcrancesi) 
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a) Cliiltl is play' ij; rliyniiui; j;,anu!r. v/Itih \;or(lr. (o-Ti-t rneat., font:, ncal:, 
swecl). Thi-.s uLli-rancL' nliould be mnrhi'd nr. [-1- Veii.al. Play]. 

b) Chi.ltl 111 vc\-\fi\tlui\ llu: word:: Lo a soii[; ouL loud. (Aclual ijlni;in[; 
in not rccDrdud in ver'ialini or in Lliu Conlc'y.t; CodiJ.) 

c) Cliild ir; nititing alono and repeal in[; Lho v/ord 'flier.' to hiin/herself . 
(jWTn: Tlu'r; function ir. not scored v;it]i rerjpcct to tlie A[)propriatc 

catej;ory . ) 

10. li!ii La t i on : An imitation ic the reju-ti tiun of an immediately precedinr^ 
Verbal Stinmlus of another speaker. In thir. case, only exact repetitions 

_ are scored. All ^^7ordG in tlie child's utterance must correspond to the 
words in the immediately preceding; adult ot peer Verbal Stimulus, 
alt]iou[;h not every v;ord must be included for it to be scored as an 
imitation. 

Examplos : Adult - It's a ball. Adult - It's a ball. 

Child - It's a ball. (IM) Child - a ball. (IM) 

11. Repot :i t ion : A repetition is scored when the cliild utters a duplicate 
of his own immediately procedin£^ utterance. All the words in the 
child's repetition must correspond to .'^ic words in his/her own 
immediately preceding utterance, althou^^li not every word must be 
included for it to be scored as a Repetition. 

ExampI es : 

a) Child: 'I don't need one' 

Cliild: 'I don't need onc^ [+ Repetition] 

b) Clrild: 'I want another piece of paper' 
Child: 'Anotlier piece' [+ Repetition] 

(NOTE: The function of the child's repetition must be tlic same as his: 
previous utterance.) 

12. Commissi ve : A commissive is scored if tlie child verbally indicates an 
intention or anticipation of his own future action. ^ 

Exampl cs : a) 'I'm gonna make a airplane' 
b) 'I'll do it' 
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13. 



15. 



f>('1 r~i :rr 111 ;it oi'v ; Thi.i; fuiu'tion if. jjcorcil if Llie child uLU.t:'. a iicnLuncc 
which i;t'(-'iii:i lu .serve no .'ippareiU coniuuiu i c.i t iv(i piirp(.i?.;L' olhi'i" Lhiin to 
direct hiMVhis own chain of thou)'Jit. That is, if the (-on! (mU: of the 
chilcrs lUlerance lij, related to thu tar.l; in v;hich he/she ii: currently 
eni_;a}v'd, fleJ f-Re[j,u].a tory should be scored. 

r>:anip1 es : 
Si tun r i on 



Child is talking; to him/hurself while 
trying;; to put a pu>:;:le togetlier. 



a) 



'Let me r' 



b) *This one doesn't fit' 

c) 'I need the blue one' 
• d) 'Where is it?' 

(NOTK: This function is assuraed to be approprinte. Mark every 
utterance scored under this category as + Appropriate.) 

Ros]>onse to Correction : Wien another speaker corrects sone part of 
the observed individual's previous utterance and the observed 
individual responds to the correction, a Response to Correction is 
scored. (Another speaker's corrections include corrections of articula- 
tion, lexical usage, content, syntax, or pragmatics.) 



Examples : 

a) Child: 
Adult: 
Child: 



'Blue one' 

'No, not blue, red' 

'Red* 



b) Child: 'Coot me up' 

Adult: 'Say scoot not coot' 
Child: 'Scoot me up' 



(Incorrect lexical usage) 

(AduJ.t ' s correction) 

(Child's response to the correction) 

(Incorrect articulation) 

(Adult ' s correction) 

(Child's response to the correction) 



Response to a Mand otlier than n Question or Correction : This function 
is scored when the child responds to any mand other than a question or 
correction. 



Exampi es : 

Hands . 

a) Adult : 'Do you have a blue one?' 

(This is a question - the speaker 
is cocking inforaation) 



Responses 

a) Child: 'Yes' 

(This response should be scored 
as an Answer because it Is a 
response to a Question) 
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b) Achil t: : 'Nu, uol l»]ue, red' b) CjiLyj 'Kcd' 

(Tbii; ii\ ri Cunccllcn - Lliu (This r.luuild bi! :;coruLl as a 

fi]U'al:er iii con rc I i Lho Re!;pon!ic to Curi ocLion) 
ccnilonl. of Liu* chULr?; 
p r CI V 1 f UKS u C 1 0 r m n c u ) 

c) Adu1 1: : 'Can you r.ny ca!;h rtM; iiiLur? ' c) Chile] : 'Ca:;li rogisLi-'r* 

(This is a Mand olIilt Lhan a (Thifj in a Uor.)U)nr.e to a 

QuejiLiou or Correctictn) Mand oilier Ulian a Qucr.tion or 

CorrucLion) 

K^- U»icnd.d)l i* : UtUeranccc^ wlior.o funcLion cannot be dctonaJ ncd usin^ the 
ruloH incarporatcd in Lhtj Ob::Lirvat;:i anal riuvchaL-L (sea tlie Appcndi::), 
^ should be scored as Uncodable. That is, uLterancos wliosc function is 
anibijj;uous should be scored as Uncodal^lc. 



Com ex I: O'l'' 
Vai'c VA\\\\l 
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(VMkiL t:o do v/hun Lliu fuiicMcMi of an utlc^.rance i;;. not. cJcar.) 

Hnny of the child's IntciiLloni; which are clearly pru:;onL in one situation 
may 1)C ohr.cure under diffarcnt condilions. There will be occar;lons when 
an uLleranet? can not be scored because it: ii: arabi[',uouL: in leniu; of 
function. These utterances must be recorded even if they can't be coded. 
In many Instances, the observer can take advantat^e of various nonverbal 
cues of speakers and listeners in the determination of the codaliility 
of an utterance. To help the observer reach a decision in the codin[i 
of potentially ainbi>;u<3|Us utterances, the observational priorities to be 
followed, v;han coding is not irunediately obvious, are presented below 
in the fom of a flov;chart. 



12) 



CP.flTXT COlJi: 

Till" Mow cliiirl. (t iaqiMiiiiiicd ir. Lo In.' iimmI in iimh i l:iin f. ion 

V/Ikmi iL is niil. iiimit'd iii to ly obviuu:. how l.o c las;. i(y ii (jiv(.'ri ul. I.oriuici; 



A 



V 



V 



V 



Classify 
Utterance 



YES 



YES 



YES 




Cue 


Off 


Child 


BeliQvior 




Classification^ 
Obviou; 



Cue Off 
■ Listener 
Behavior 




Throw Out 
Utterance 
(too ambiguous) 
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CP. : 'Can you ("liul .inot licM' red lt.U)cl:?' 
CI 1 1. Id : rcluT. , tlien pi cl::; up lil orl.) ' Hi' re ' 

[Clar.siriiMt ion: noL oIa'.ujuj; at: pt)inl] 

b ) Cut> Off nil ild P.o1 u I V 1 ro- 

1. Cliild exCench. arm lioldinj; blocl: toward li.Mtcuur at IIvao of 
utterance: , 

[Clnsfiif ication : not obvious ] 

or 2. Child holds blocl; up (not cxtcndin[i arm toward lintencM') wlule 
looking for lii;tencr reaction. 
[Claficif ication : + vocative] 

or 3. Child places block with other blocks at time of utterance and 
is disinterested in lictener reaction. 
[Classification: + declarative] 

c ) Cue Off h i stener rjelinvior 

1. Listener tal:es block from child's extended hand (v;ithaat 
resistance from the child) 
[Classification: 4- rcquest/co::i:uand] 

or 2. Listener takes block (child resists). 
[Classification: -f declarative] 

or 3. Listener does not react to child extending; hand holdin[; blocl;. 
(Child does not persist in extending; arm) 

[Classification: not obvious — throw out utterance (do not 
code function) ] . 

It is important to remember that this flowchart is only an aid. If you 
can reach a conclusion throu^b other means, by all means, do so. 
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CONITXT colli:: DATA Stlll.T 
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(II I 'Wry 1)1'^ 
(.1 riliiAI. 



Cilll.lJ VLKflALI/Al lull 
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Appendix 3 

A Suiiiiikiry of Parent and Teacher Follow-Up Survey Responses 
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I I. Vn ii I 0 I li)V; U)) 

A Miium.iry ot llir ri'spou'W^s ot i;* p.ircnls ( cciir't'MMi ( i iki I,' (hiliiriMi 
invt'lvt'il \\] ([)(• y,Mi ol l:hr loMow-iip '.(.ufly) lo .1 JphiiltMl i|u»^s 1. jnn" 

1 niMrni i IK) LtuMr |hm'( t'p (, i ons ol IhiMr' ctrild''. i (Hiiinuii 1 1 .i t 1 vis '.lu.i.M 
•iiiUirKiii skiM'» hi'torn dnd .it Lor .i K.imhI i iMj hif^iiu.uic I'ntitu.L Prcsttioo 1 
i' pit'M'fit I J )M I. Ihc iiKMii .mil Tiifnio ol p.iriMil r'i'\pi)nM.»% (.0 

'^i' t» (jiiL'srion is rr'porri'd. A I-/ sunuinLic d i M imm.miU I '.(.ilcwu^. oinploytnl 
m the 'jurvuy. 

IlH.' iiuMiis tor tf)e di 1 1 orcMit Ui 1 scale wero ohtdioiMl in the followinr) 
iiiciniUM'. ilio miiiibor circles for eacti (;-]estinn 'vds recorded on one coin[)osito 
p.ir'tMit cpjesLionntiire fonii. When two contiguous numbers vyt.M'o Lirxled, then 
ifU' [joint vdlup between those nuiiil)ers was recorded, (for t^•<al;)ple, if 4 
dOfi \j were both circled, then a [)oint value of A.b wus assigned cind 
includf'd in ttie suiiina ti on . ) Each number on the scale wd^. multiplied by 
the number of subjects who received that number. Ttiese [jroducts were 
added totjet>)or' and then divided by the total numbcM' of children (11) to 
obtain a n^ean for each question, both before and nfter ttie children 
attended Ldr^cjuacje Project Preschool . 

These means (Table 1) indicate that the parents [)received an increase 
of at least Z years for every question under the headings ot language and 
academic skills from the time their child entered Lan»,uatje Project Preschool 
to the time of departure. Parents also perceived a siiiiilar increase in 
social skill's except for how easily their child could hecoi.ic upset (question 
number 8 indicates an increase of a little over a year) and a very slight 
decrease (0.1 ()oints) in how often ttieir child is a(;grcssive with peers 
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or s i li t I iMi', ( ijiii", I (oil iiiiiiiIm'I' I I) , 

AM 1)1 ♦tfi'.wiM In (lie n|MMi pimIpiI i|Ui'% t H mi'. in Km I N ol 

ilMjui Mv ut jMij'iil', WMr I'X tiMIIlt' 1 y |»liM',r(| v; j I ll I Iw pl'dMrr'SS l\\v\r 

( In M iiM*l«' l.iiMHi.iijr Pro^iclinn I . lour p^iront', oiirrtMl ^iin.itc* I i ons 

to iiou I .uwju.HM* Pi'rijJH:!. Prr"a:tu)o| roulil irivt* iihulo ilnMi' ( hlM*'. 
iul ju'. liiK'iil l.() piihlic m:Ih)(i| (MsirT, wtlilc oi(|lil. |)<ir'rii('. h.nl ilu mkMi"* Mofi'. . 
A Miimtidry t)| t lii' trMiJu'r »uisv/oi^S 1,0 Mir (i(»rir rnt|oil ijur s t i on*, li) 

t ion A ot Uii» [(MctiLT (]ijt}s LioDiun An) priM.r'nl.rMl in 3. 1 1, is 

inlL'rr',. tinc) to no to t.hat four toachors str'ossod Uiat. , in l\v*\v ooinion, 
,i!)pro|)riat:o social skills are much noro in.piM^Lint: lor nr^rschoolr. to toach 
tfjan acacU.Miiic skilhi. One teacher froi:; a snail rural srhoul noted that she 
Sfos a larcje discrepancy betv/een students v/ho liave attended preschool and 
tliose v.'ho have not, particularly in regard to the social skills. With the 
chcHUjing oconoiriy, the preschool in her' area v;as closed so that only a 
few of her kindergarten students had attended orie, and this fias nuide 
tlie difference betvieen children vjIio attended prescliool and those who have 
n(U much n^ore discernible. 

iciDle 4 summarizes the responses of 12 teadiei-s (representing 12 
children involved in tlie follow-up study) to a detailed (|uestionna i re 
concerning their perceptions of the child's communicative, social, and 
academic skills exhibited in their school during the year following atten- 
dance at Language Project Preschool. The mean and range of teacher 
responses to each question is reported. A 1-7 semantic differential scale 
v.'ds err.ployed in the survey. 

The means for the differential scale were obtained in the following 
manner'. The nui'iber circled for each question was tHKordf^n on one composite 
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teacher questionnaire form. When two contiguous numbers were circled, then 
the point value between those numbers was recorded (e.u., if 3 and 4 were 
both circled, than a point value of 3.5 was assigned and included in the 
sui:;inat ion) . Lich nunber the scale was then multiplied by the number 
of su()Jr'cts who received that number. These products w(.mh.^ added together 
and tiion divided by the total number of children (12) to obtain a mean tor 
t-acli question. The means and ranges for these tjuestions are presented in 
Tjl)li' 4. 

I* teachers' answers to the open-ended djue^-^ions in Section B were 
coi:;pilea and are presented in Table 5. If standardized tests had been 
adiii I n r.lcrod , but tfie results were nut yet a Vci i I <i i - 1 c , thon this information 
was not reported. 
;'fid Year f'p 1 low -Up 

Six follow-up stuc'c'nts had parent and teaciier cjues tionnaires returned 
for d second year (in addition to the first year). Metins were computed 
in the same n;anner as described for the [jarent and teacher cjuestionnai res 
in liie fir^st year follow-up. One child's surveys v/ere not included in 

aria lysis because the parents did not isark any answ;,TS coiKerning the 
(MiliJ's bf.'iiavior^ before he attended Language Pr^oject Pr'(^sch(>ol (in the first 
yoar tollow-uf' ar^alysis). JhevQ appears to be very liLLle difference in 
the two sets of responses, indicating fairly high test-retcst reliability. 

Iho means of the teacher responses for two years oi folluw-u(J for the 
same '> chihhor. arr presented in Table 7. All of tho dilforences are less 
tnan one year (1,0), except for questions 15 and 22 (indicating a 
decrease in teacher^ -percei ved aggression) and cjuestion I'b (wiiich indicates a 
doe.ro, ISO in t\\Q amount of disruption to classroom routine. 
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Table 1 

SUMMARY OF PAREfJT RESPOIiSES - PART I 
1st Year Follow-Up 



Question 



Before LPP 
Mean (iJ=ll) 



After LPP 
Mean (N^U) 



Di f f erence 



L'\n(juafje Sk ij 1 s 

!. r;v,-/clear or easy to under'stand is your cfii 

speech to those v^tio do not kwovi hiui/tier? 

i^:\L^£.yiiLyJJ.y___^^^^ 



3. 



How often does your child understand what is | 
being said to him/her? j 

..LLl.j^:^»^Iii„. _ _ . _ J 

r 

flow well does your child follow instructions? 
(7 = f ollow s all) 



2.1 

(range = 1-3) 
3.5 

(range = 2-6) 



5.3 

( range 4.5-6) 



5.9 

range = 5-7) 



3.0 

(rang e ^ 2-6) 



5.8 

(range - 5-7) 







4. How often does your child talk? 
(7 = v er y fre quently) 

5. Overall, compared to other children of the 
same age, how would you rate your child's 
language ski 1 Is? 

(7 = f ar a bove age level) _ 

Socjal Ski lis 

6. How v;el1 does your child adjust to new situations? 
i.7-.f.6j<j;raTie}Jy_ adaptable to all tiew situations) 

7. How well can your child do things on his/her own? 
(7 = far above aq_o__l evel ) 



2.6 



1.7 

(ranqe = 1-2) 



6.6 

riL?, = 6-7) 

4.9 

(range = 3-6) 



8. How easily upset is your child? 
(7 = e xtrem e J c a jjn ) 



3.2 
2.8 

(_r_an5e_ =__!_-_. 
4.1 



6.0 

_ _( range = 4-7j^ 
6.7 

j_ran^e_ j^_4-7_) 
5.4 



+ 2. a 



+ 2. -J 



+ 3.0 



+ 3.Z 



j . _ij.^."5iL J_ .L'JJ t _( range = 5_-_7j 



+ 3.9 
+ 1.5 
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Question 



9. How good is your child at playing with other 
children? 

(7 = plays extrerrely well with other children) 

10. How well does/did your child talk to and social 
wi th adul ts? 

(7 = ^cij abo^ jge^l ev^lj 



11. How often is your child aggressive with peers 
or s i bl i ngs ? 

( ^"^ l^LOs .'^1.1. th^^ tiine) 

12. Compared to children of the same age, how lonn 
your child's attention span? 

- very long) 



Academic Ski 1 1 s 

How does yaiir child compare to his/her peers in the 
following conceptual/academic skills? 

13. Counting/math 

(7 = far above a ge 1 e v ej ) 

14 . Pre-readi ng skills 

(7 - far q bov^e_ age_l eyejj 



15. Overall skills 

L]_^_f^Ii,^oy^_dae^ 1 evel ) 



14 u 



.■i^ore Lf'F 
'Gan = 



3.5 

(range = i-7) 



2.4 

(range = 1-5) 



4.0 

(ranqe = 1-7) 



After L-'P 
i!ean (fi=ll) 



5.7 

( range = 4 7) 



5.5 

(range - 4-/) 



3.9 i 

range = 2-6) i 



Di f forence 



+2.2 



+3.1 



-0.1 



2.7 

range = 1-6) 



2.4 



1.9 

(range = 1-7^ 



2.5 

(ranae = 2-4) 



5.0 

(range = 1-7) 



5.5 

(range = 4 ^7J 



5.1 

(range = 2-7) 



5.1 

(ra nge = 4 -7) 



+ 2.3 



+ 3.1 



+ 3.2 



+ 2.6 
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Summary of Parent Responses Part II 
Parent Questionnai re 

Followincj each cjuestion are the various ansv;ers given. The number follovnng 
each answer refers to the number of parents who gave that answer from a total 
of 12. . 

1. To what do you attribute the changes or lack of change noted above? 

(Preschool [)rogram, language training, child growing^p, other preschool 

program or services, your own work with child, public school classes 

or special services, etc.) 



Al 1 of the above 5 

language Project Preschool-- 9 

Pr'eschool ^ i] 

Language training 3 

My own work i 

Perceptual motor 2 

Special services l 

L.U. classes 1 

Summer reading 1 

Math at LPP 1 

Growth 1 



2. What might LPP have done to make your child's adju-. tmerit to public 
school easier? 



Nothing (they did a great job) 8 

Could have worked more on teaching understanding 

of what v/as read or taught 1 

More paper and pencil skills 1 

Could have taught my child to pay better attention 

to teachers ] 

He did not receive enough language training; 

teachers this year had a hard time understanding 

my chi Id — i 



3. Hu your child received any special services in the public schools? What? 

Special Education classes 5 

Speech 3 

^'^o special services 3 

Perceptual motor clinic 1 

Psychologist one day a week--l 

4. What (if any) problem has your child encountered in school since leaving 
LPI^? (For example: academic problems, social or behavior problems) 

Social i ntLMMction 1 

Debatable — it depends on the teachers 
Frustration (due to my child's 
hearing loss) due to lack of 
proper cominnnica tion 



fione 4 

Behavior probleins--3 
Slow to learn 1 
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Table 3 



Language Project Preschool Teacher Questionnaire 



Section A Results 



The number following each category represents the number of teachers, out 
of a possible 14, v/ho marked those skills as important. 

1. flow long would a kindergarten child be expected to sit and remain on task? 
15 minutes 6 

10-15 minutes 3 (with one teacher cfianging this to 

25-25 minutes for 2nd semester) 

3-8 minutes, then 10-15 minutes--! 

15-20 minutes 1 

30-40 minutes 1 

2. U'hat cognitive skills do you feel are most important to insure a child's 
readiness for the public school system? 



Letter recognition 7 

Count to 25 aloud 5 

U'ri te own name 4 

Number recognition 4 

Col ors 3 

Sound discrimination 2 

Visual discri mi nation 2 

Spati a 1 relationshi ps 2 

lirite numbers 2 

I . 4-6 ini tial sounds 2 

Rhymi ng 2 



Recognize own name from arnyy of names 1 

Tell simple fairy tale in correct sequence 1 

Do 2 tasks in sequence v/ithout teacher proi.ipts--! 

Lefi to right 1 

Sizes 1 

1 to 1 correspondence 1 

Addition (to 5) 1 

Complex matching 1 

Seasons — 1 

Say ABCs 1 

3. What social skills do you feel are most important to insure a child's 
readiness for the public school system? 

Social skills are more important than academic skills; 



unsolicited opinion 4 

Get along with peers 7 

Follow directions G 

Listen \wl 1 5 

To function in large groups without fiiuch 

i ndi vidua 1 attention 5 

CoitJiiuni ca te own ideas 3 
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Table 3 



(r^3 cont'd) 



Share v;i th others 

Speak to group 

Work on-task 

Sel ( -help ski 1 lb 

lake turns 

Positive self-concept 



-3 
-2 
-2 
-2 
-2 
-2 



Handle conflicts verbally, independently 

Use scissors & paste correctly 2 

llov/ to enter groups 1 

Avoid aggressors 1 

Walk inside building 1 

Ask for help appropriately 1 

Gross motor ski 1 Is 1 

Initiation & completion of short tasks — 1 

fiands on own work only 1 

Hold pencil & crayon correctly 1 

4. What experiences should preschool children have to ()ro|)are them for 
a smooth transition to kindergarten? 

Read to the child 1 

Develop chi Id 's curiosity 1 

Develop child's attention span — 1 

Develop language skills 1 

Build child's independence & sel f-conf idence-1 

F d trips 1 

lluny different types of experiences, in out 
out of school 1 
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SUMMARY OF TEACHER RESPOfJSES 
Teacher Questionnaire - Section B* 



Question 



Language Skil 1 s 



r-'ea n 
1st Fol low-Up 
_._ (tj^l2) 



Range 
Fol low -Up 
(N=12) 



1. How clear or e^isy to understand is this child's speech to 
those who do not know hin/her? 

P>^cpP_tjpnaJ ly^ ec\<^y^ to unders tand ) 

2. How often does this child speak in complete sentences? 
^,1 ways) 



4.6 



3. How would you say this child's vocabulary compares to the 

vocabularies of other children his/her age? 
■■„-.,lZ,iLjllMgl^ ^'Q*^^ extens ive - a very l^rgejvocajuj^rj/ ) 



3.9 



4. How often does this child communicate his/her needs verbally 
rather than nonverbally (for example, by pointing)? 
(7 = always uses lanqu_agej 



4,3 



5. How often does this child understand what is being said 
to him/her? 

(7 = always) 



5.2 



How well does this child follow instructions? 
(7 = follows all) 



7. how often does this child talk? 
(7 = very frequenjj y_) 



4.9 



4.9 



8. Overall, compared to other children of the same age, how 
would you rate this child's language skills? 
( 7 = far above age level ) 

^Each question includes a Likert rating scale ranging from 
1 to 7. 3-5 IS considered the average to good range. 



3.& 



1.5-6 



1-7 



1-6 



3-7 



2-7 



2-7 
2-6 

1-6 
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Question 



Social Skills 

9. How well does this child adjust to ^.w situations? 
( 7 = extreme ly ada p table) 



10. How well can this child do things on his/her own? 
(7 = far above age 1 evel ) 



11. How cheerful and outgoing is this child? 
{]_ ^J5Ar.?0L^J Pi^ i ng ) 

12. How easily upset is this child? 
(7 = extremely calm) _ 

13. How good is this child at playing with other cfiildren? 
(7 - plays extremely well with oth erchi Idren) 



14. How well does this child talk to and socialize with adults? 
L7 = far above age level) 



15. How often is this chile aggressive with peers or siblings? 
(7 = almost al ^ i me) 



16. How often does this child play with materials and toys 
appropriately? 

(7 - always) 



17. Compared to children of the same age, how long is this 

child's attention span? 
(7 = very long) ^ 



Academi c Skills 

How does this child compare to her/his peers in the following 

conceptual/acadennc skills? 

18. Count! ng/ math 

( 7 - far above age level) 

19. Pre-reading skills 

1^ = far above age level) 

ERIC 
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Mean 

: 1st Follow-Up 
1 (N=12) 


Range 
Follow-Up, 
(N=12) ^' 


1 

I 





4- 
I 

I 



2-6 



4.1 

5.0 
4.1 



4.1 



1-7 



4-6 
2-6 



1-6 



4.S 


3-7 


3.3 


2-5 


5.3 


3-7 




2-6 


4.3 


2-7 


4.1 

i 


2-7 
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Qi^estion 1st Fol low-Up 

1 (N=12) 


Rdnoe 
Fol low-Up 

(N=12) 


20. Fine motor/writing ; 

(7 = far above age level) I ^* 


1-7 


21. Overall skills 

(7 = far above aqe levelj 


- 

4.0 


1.5-6 


How does this child compare to her/his peers in the following 
behaviors? 

Z2. -igression to peer's 

^ ' in oh ly ayyr^ess i ve) 


h — __j 

4.0 


1-7 


23. ui stractibi 1 i ty 

^7 = highly di stractibi e) 


4.1 


2-7 


24. Independent working skills 
(7 = consistently interacts) 


^ ■ 

3.8 


1-6 


■ 

25. Destructive with rriaterials 

(7 = never uses materials inappropriately) 


5.4 


2-7 


26. Disruptive to classroom routine 
(7 = never .di srupts classroom) 


4.3 


1-7 
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S'^ir-'ary of Teacner Responses 
Teacher Questionna ir'e - Section C 



yes , speci fj 



L.D. class; 
speech therapy 



Speech therapy 
( for articula- 
tion) 



Probler.s in 
CI assroon 



Very distractible 

or e.' dudes al 1 
olher sii:;:u i i 



-needs constant 1 
feedback on i 
assigni;<ents j 

-fol lows directions! 
better i n sral 1 \ 
(4 roups i 



•us.'.' ^ b^'\Dy' • 
ar t i cu 1 J 1 1 on i nc: 
group tjr.e^ _ _ 



Passed to 
I^ext Grade 



Yes 



Standardized Tests] Child's Strengths 
(rating) I and Weaknesses 



Stanford Binet 
( normal ) 



No 



-Very friendly, 
helps younger 
chi 1dren, abo . e 
avei'age i n . se1 f - 
help skills 

-Passive, has trouble 
, understanding simple 
, directions 



-Peabody - below 
average 1 n oral 
vocabulary and 
gramma tic comple- 
tion 

-age level in 
picture vocabulary 
and grammatic 
understanding 

-above average in 
sentence ini tiation- 



'-trusting, eager to 
! olease 



Yes 



Yes 



-inte1 1 igent , curious 
patient 
jjhy_ _^ . 



-curious , understands 
concepts 

-weak in language 
skills 
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Grade 



1st 



Kdg, 



1st 



Kdg. 



Special 
Services 
Yes Ilo 



X 



Preschool t 



I f yes , speci fy 



Speech; L .D. 
Psychono tor 
clinic 



Probl ens i n 
Classroom 



-anything new 
-large group 

ac ti vi ti es 
-being in fr^ont of 

class 

-social ly and 
emotional ly below 
age level 

■ sched u Ij nj]_j2_robJ eni 



Passed to 
:iext Grade 



No 



Standardized Tests j Child's Strengths 
(rating) | and Weaknesses 



Iowa Basic Test 
(below age level ) 



|-happy, cooperative, 
j tries to please 
j -probl em wi th 
reasoning and compn 
hension in all area: 



Spcecn and 
[ledr i ng 



Yes 



Speech 



-coed rremory, can 
I work i ndependently 
, wi tnout rrucli 
j di f f i cul ty 



Yes 



-fol lower of 
i nappro()ri ate 
behavior 



Yes 



Speech 



Early Prevention 
School Failure - 
Language (below 
average) 

Anton Brennev - 
( h igh average) 



of -good sel f control : 
I good study skills 
|-opening up in 
I large group 
I di scussi ons 



[-affectionate, 

j persistent, 

I corrpliant, good 

j disposition (usual l\ 



Speech 
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-competition bothers 
him 

-hates to leave 
something he enjoys 
or not completed 

-in:patien_t 

-immature 



Yes 



No 



Stanford Achieve- 
ment ( poor on 
orally dictated 
sections) 



Metropol i tan 
Readiness 

(low in all areas) 



j-5trong academically 



I 

j-cheerf ul , cooperati 
! enthusiastic 
■low academics , 
immature languaae 
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ERIC 



1 

Cni 1 d 


Grade 

I 


Spec 
Serv 
Yes 


ial 
ices 


1 

If yes , speci fy 

u - . 1 


Probl erif i n 
Cldssroon; 


1 

Possed to 
next grade 


1 
1 

Standardized Tests 
! (rating) 


Child s Strengths 
and Weaknesses 


Da 1 e 


Kdg . 


X 




Title 1 

1 

; 




-wants physical 
contact wi th other 
chi Idren 


Should be 
put in PSA 
c1 ass 


1 

1 1 


-nice smile, 

friendly 
-has di f f icul ty wi th 

v^ritten work 



ERIC 



siiMfiARY or iv.Hc:,: KrsfMiNSEs 

1st and cwd Fol low-Up PdCfint ijuufitionnai res 



lJUL'S t ion 

1. How clear or* easy to understand 
is your child's speech to tliose 
who do not knovv ii in'/ her? 

(7 = exceiJtiona ! 1 y easy to 
unde r s j: a ml )^ 

2. How often does youf^ child under- 
stand what is being said to 
hifu/her? 

( 7 = always) 

3. How well does your child follow 
ins true tions? 

(7 = fo1lQv/s all) 

4. Nov/ often does your child talk? 

(7 = very frequently) 

5. Overall, conipared to other children 
of the same age, how v;ould you rate 
your child's language skills? 



Follow-U|j 1 
Befor^e LPP 



Fol low-Up \? 
Before LPP 
Mean {U-'>^ 



Di f fer^ence 



^ f"blTow-T'p"l 
After LPP 
Mean_ (:;-5i 



Follow4Jp 2 . 

After LPP 'Di fforence 

Meajn_^(fJ-_^5J| ' 



-0 



( ran^je - ["-3 ) ; ( ra/uje 



range - b-b. 



5 m-: 
^Miine 



j-7^ 



Social Skills 



6. How well does your child adjust to 
new si tua tions? 

(7 = extreipely adaptable to all 
new si tua tions ) 



J. 4 



2.8 



2.i 



1 o 
1 . u 





• 









h--- --- 




1 








1 

3.3 




1 

+0 


1 


G.O 




; 6.4 




+0.4 


= 2-6) 


( range 


= 2-5) 






( range 


= 5-7) 


1 ( range = 

\ — 


5-7); 






3.3 




-0 


5 


5.5 




5.7 




+0.1 


= 2-6) 


( range 


= 3-4) 






( range 


= 5-5) 


|J ranf^e = 


5-6) . 




= 1-3) 


1 ^ 




-0 


4 


6.8 




: 5.8 


X 


Same 


_(2"ancie_ 








( range 




! (ranee = 






= 1-2) 


1.4 




-0 


4 


4 . 8 




5.4 


1 

i 


+0.6 


( range 


= 1-2) 






( range 


- 3-6) 


. (r-ange = 


4-5); 




1 



















15 



2.5 ; 2.P. 

( range = 1-5) i ( rangt 
i 



+0.2 



5.0 



1-5) 



5.4 



-0.5 



( range = 6-7) range = 3-7) 
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7. How woll can your clnld do Uiings 
on I) i s/hor own? 

B. Nov/ Otjsily iipsoL is your' child? 
iL J:-..PilLL^'U!i:Jy^.i^-^ 

9. Mov; tjoof.1 is your cliild at playinq 
wi th othor chi Idr-er)? 
(7 " |ilcry'» 0;< tr'LMi:oly va.'ll wit.li otJuM' 
J^iUJi'i'^'lll, 

10. How v;g11 does/did your clii ld talk to 

and socialize with adults? 
(7 = far^ above age level J 



1 I ()l low-lip 1 f'ol luw-llf) ?.. 
r.oforu LPP ! lieforo WV 
Moan i Moan (fi-^j) 



3.2 



riinge ~ 2-5) j ( i\'\r)go - 1-5 
1-/) 



3.6 

( r_a j)(je_ 



2.6 

( f'.nup* 



2.4 



3.4 
( i\i n g o 



\) \ (' for ence 



1 tj 1 1 uw • 


1 111 1 


roil ow-up c 




After 1 


J'P 


After LPP 


Di f terence 


Moan _(f 




Moan _(Nf 5) 




5.4 




5.B 


• 

^0.4 


( raiuje 


'1-6) 


(range - 4-6) 




5.6 




5,0 


-0.6 


( range 


^ 5-7) 


(range = 4-6) 





I -i' ) ' r,:ii/|(; - 1-7) 



.0 



i 5.3 j h.2 

I ( = 5-7 ) I ( r-anqe = 4 - 7 ) 



I ( range = 1-4) ' ( range - 1 ) 



11. Hov/ often is your child aggressive 
with peers or siblings? 
( 7 - almost a1 1 the time) 



j (range = 1-6) ((range = 1-5) 



5.4 

(range = 4-6) 



5.2 

grange = 4-6) 



+ 0.4 



-0.2 



-0.8 



3.6 

(range = 2-5) 



12. Compared to children of the same age,] 
hov/ long is your child's attention 
span? 



2.4 



1.5 



-0.9 



(7 = very long) 



Academic S k i 1 1s 

Hov7 does your child compare to her/his 
peers in the follov/ing conceptual/ 
academi c skills? 

13. Counting/ma til 



j (range = 2-3) [(range = 1-3) 



5.4 

(range = 3-6) 



.4 



( 7 = far above age level ) ^ ^ i J'^^I'S e s t' ^ L i \ l''^ 1_ ljl?J_ 



14 ^re-reading skills 

( 7 = far abo v e ag e_l e vol _ 

15. Overall skills 

(7 = far above age level) 



-0.8 



6.0 



4.4 

(range = 4-6) 



+0.8 



5.5 

(range = 4-71 



+0.1 



5.6 



-0.4 



L ('^an ge = 5-7) (range = 4-7) I 



I 1.0 ; 1-0 Same 

\ 2.4 \ 1.3 I -0.6 

I (range = 2-4) ; (range = 1-3) 



5.5 



5.4 



I ( ran ge = 4-7) j ( ra nge = _4_-_5j_j 



-0.1 



ERIC 



15J 



5.2 



5.4 



+0.2 



(range = 4-6) j (range = 4-6) 
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'.IJMflAh.' 
lion 



ijiM.^s I. ion 



I (ii)(jii(i<jo M-; ills 

1. lic'w uli'ar' ()? iM**,/ Li) undei's Ldtul is tin', 
child's spoocli to tliostj wlio do fioL know 
li iip/H(M^? 

(7 ^ exceptionally odsy to unders taod ) 

2. How often does tfiis child spedk in 
complete sentences? 

(7 = dlwciys) ' 



3. How would you say this child's vccabulat'y 
compares to the vocabularies of other 
chi Idren his/her age? 
(7 = much more extensive - a very large 
vocabulary) 



4. How often does this child corimunicate 
liis/her needs verbally rather than non- 
verbal ly (for example, by pointing)? 

17. J", jj way s_ u s e_s 1 a n^ua gej _ 

5. How often does this child understand 
what is being said to him/her? 

AJ^J w.^y.^J 



6. How we I. does tliis child follow 
instructions? 
(7 = follows all) 

ERIC 



f'l(Mf) 

s I uuw I'd 1 t ^tw-L 



j ( rdiuje - 3-6 ) 



5.4 

r'dnye ^ 5-7) 



4.2 

range = 3-6) 



4.8 

range ~ 3-7) 



5.6 

\ r'ange = 4-7) 
4.6 

range = 2-6) 



16i 



Y(M f I 1)1 I i)w-ll|) I V(i 1 iiii I, j on' 



Y(M I' Co 1 1 ()v/-l)() ' 

(ri-5) ! 



Oi f t t'i'OMCi? 
I lie r i'iis(.' (t ) or (t(.H;ri?JS0 ( -) 
from I'iL Y(Mr 



'1 . .1 

Iramjo = 3-6) 



-0..:' 



4.4 

rdiujG = 2-6) 



-1 .0 



4.0 

i-diKje = 2-7) 



-0.2 



-0.6 



4.b 

range - 3-7) 



4.4 

(range = 2-7) 



-0.2 



1«2 



10. 



11 



ui". Mod 



H(tw oi Lnii udc'. tni'. ( hi M r.i Ik 
( / - viM'y ( f(:H|U(-n t ty 

Ovt'i .1 1 1 . (,()fii(),ir'i*(| (i) nllier t 111 hli CM of 
Uh' Sdiiio .KMs how would you ? ,i(o Kii'. 
t:hi Id's l(ini)0iOjO sk i Ms i 
( / (tL )Vo .itjo li.'vi'l ) 

i.i I '.ki II', 

1'*".' v;i'| I .h.f , ([lis . /n Id .id ;ii ,1 (i- Mcu 
:. i t.U(i t i oir, ■ 

L\< Lr'Olliol > (idtl(Acd) 1 1; to dll WM 

i tuat ioos) 

Mow well can this child do tdiiocj^s on 
hi'^i/hor owD? 

How cheer'ful and outrjoing is tiiis child? 

How Gdsily upsGt is this child? 
(7 - extremely caln, nothing over 
bothers) 



13. 



14. 



15. 



How good is this child at playing with 
other chi 1 dr-ei^? 

(7 = plays extrei'iol.y well with othor 
chi Idren) 

Hov/ well does this chi la talk to and 
social ize wi th adul ts? 
-.ii_.f_ Jjr_ :?i^.P.Y.L ^^5^ 1 ^ ve 1 ) 

How often is this child aggressive 
with peers or siblings? 
{ 7 = dlmos tall trie time) 



Isl: Vp.n I OI low- 



I ll I 



.0 



'1 . 1) 



; .'1 

(I'tinijL' ■,-()) 



(raiiije = c-6) 
5.U 

_( ranqe - 4-t, ) 
4.0 

(range = 2-6) 



4 . 4 

(range; = 1-6) 



5.0 

( range = 3-7 ) 
4.0 

(ranoo = 1-6) 



: fl^.MH iJi f forenco 

l^p I ;-iid Yo.ir ro||ow-ll|) Incr'(>aso (r) or' docri'aso (-) 
I , (N-^^)) trodi 1st Year 



. (;^Hioo ■■■ 




1 .Id.) 

1 ( ran'ji* ! ti ) 

1 
( 


'.iiirt.' 

1 

1 

1 ■ 


j ( rsinge - ) 

i 


\ 


i 

! ( rviruje 2-1) 


+ U . b 


\ 5.6 

i ( r-anje ^ 5-7) 


-^0.6 


i 3.0 

( range = 2-6) 


-0.2 


\ 

I 4.7 

' ( r a n CI e = 2 5 - 6 ) 


»0.3 


\ \ 
\ 1 

(range - 2-7) I 


-u . ^ 


: 2.6 

j (range = 2-4) [ 


-1.4 



I 



I 

I 1G4 



■"ec'!'^ ' fiean j Differe-^ce 

ist rear Foliow-jp 2nd Year Fol low-Up ' Increase (+) o Decrease (-) 



IMJ 



from 1st Year 



5.2 

(range = 3-7) 


5.4 j 
; (range = 4-7) 1 


+0.2 




4.0 

( VF\ rin p ~ ? - ^'i ] 


■ 4.1 1 

\rciiKJt_ c / } ' 


+0.1 

- 




( rdn(]Q = 2-7 ) 


4.;j ; 

_i rajiae =4-7) ^ 


+0 . 2 




4.5 

( ra ncjo ^ 2-6 ) 


; ^-5 1 

; ( range = 3 . 5-6 ) j 


Same 




4.6 

( rarKje = 2-7 ) 


4.8 1 
1 ( range =4-7) j 


+0.2 




4.0 

( ran^e = 2-6 ) 


\ 4.2 1 
' ( range = 3-6) I 


+0.2 




4.4 

( i;- a_n [:_e j - 7 ) 


i 1 

■ ( 
• i 

; 1 

( ranqe = 2-4) i 


-1.6 





a. 6 

( ranr,e = 2 -7 ) 


4.6 j 
1 range ^ 4-7 ) i ^ 


Sair.e 






; • 2 " 

{ ranqe ^3-7) 


+0 . 




5.2 

(range = 2-7) 


! » 

{_rancje = 4-7j [ 


Same 





4.6 

ange = i-7) 



6.0 

range = 4-7) 



+ 1.4 



